R for Biologists course

R takes time to learn, like a spoken language. No one can expect to be an R expert after learning R for a few hours. This course has been designed to introduce biologists to R, showing some basics and some powerful things R can do. The aim is to give beginners the confidence to continue learning R, so the focus here is on tidyverse and visualisation of biological data, as we believe this is a productive and engaging way to start learning R.

Intro to R and RStudio

RStudio is an interface that makes it easier to use R. There are four windows in RStudio. The screenshot below shows an analogy linking the different RStudio windows to cooking.

     

R script vs console

There are two ways to work in RStudio in the console or in a script. We can type a command in the console and press Enter/Return to run it. Try running the command below in the console.

1 + 1
[1] 2

Or we can use an R script. To create a script, from the top menu in RStudio: File > New File > R Script. Save it as intro.R. Now type the command below in the script. This time you use Cmd/Ctrl + Enter/Return. This sends the commmand where the cursor is from the script to the console. You can highlight multiple commands and then press Cmd/Ctrl + Enter/Return to run them one after the other.

2 + 2
[1] 4

As the RStudio screenshot above explains, if we work in the console we don’t have a good record (recipe) of what we’ve done. We can see commands we’ve run in the History panel (top right window), and we can go backwards and forwards through our history in the console using the up arrow and down arrow. But the history includes everything we’ve tried to run, including our mistakes so it is good practice to use an R script.

We can also add comments to a script. These are notes to ourself or others about the commands in the script. Comments start with a # which tells R not to run them as commands.

# testing R
2 + 2
[1] 4

Working directory

Opening an RStudio session launches it from a specific location. This is the ‘working directory’. R looks in the working directory by default to read in data and save files. You can find out what the working directory is by using the command getwd(). This shows you the path to your working directory in the console. In Mac this is in the format /path/to/working/directory and in Windows C:\path\to\working\directory. It is often useful to have your data and R scripts in the same directory and set this as your working directory. We will do this now.

Make a folder for this course somewhere on your computer that you will be able to easily find. Name the folder for example, Intro_R_course. Then, to set this folder as your working directory:

In RStudio click on the ‘Files’ tab and then click on the three dots, as shown below.

In the window that appears, find the folder you created (e.g. Intro_R_course), click on it, then click ‘Open’. The files tab will now show the contents of your new folder. Click on More > Set As Working Directory, as shown below.

Packages

If it’s not already installed on your computer, you can use the install.packages function to install a package.

install.packages('tidyverse')

We will see many functions in this tutorial. Functions are “canned scripts” that automate more complicated sets of commands. Many functions are predefined, or can be made available by importing R packages. A function usually takes one or more inputs called arguments. Here tidyverse is the argument to the install.packages() function. Note that functions require parentheses after the function name.

Getting help

To see what any function in R does, type a ? before the name and help information will appear in the Help panel on the right in RStudio. Or you can search the function name in the Help panel search box. Google and Stack Overflow are also useful resources for getting help.

?install.packages

Tab completion

A very useful feature is Tab completion. You can start typing and use Tab to autocomplete code, for example, a function name.

Common R errors

R error messages are common and can sometimes be cryptic. You most likely will encounter at least one error message during this tutorial. Some common reasons for errors are:

  • Case sensitivity - In R, as in other programming languages, case sensitivity is important. ?install.packages is different to ?Install.packages.
  • Missing commas
  • Mismatched parentheses or brackets
  • Not quoting file paths

To see examples of some R error messages with explanations see here

Getting started with data

Data files

The data files required for this workshop are available on GitHub. To download the data.zip file, click the ‘Download’ button that’s in the middle of the page. Unzip the file and store this data folder in your working directory.

GREIN (GEO RNA-seq Experiments Interactive Navigator)

In this tutorial, we will learn some R through creating plots to visualise data from an RNA-seq experiment. RNA-seq counts file can be obtained from the GREIN platform. GREIN provides >6,500 published datasets from GEO that have been uniformly processed. It is available at http://www.ilincs.org/apps/grein/. You can search for a dataset of interest using the GEO code. We obtained the dataset used here using the code GSE60450. GREIN provide QC metrics for the RNA-seq datasets and both raw and normalized counts. We will use the normalized counts here. These are the counts of reads for each gene for each sample normalized for differences in sequencing depth and composition bias. The higher the number of counts the more the gene is expressed.    

RNA-seq dataset

Here we will create some plots using RNA-seq data from the paper by Fu et al. 2015, GEO code GSE60450. This study examined expression in basal and luminal cells from mice at different stages (virgin, pregnant and lactating). There are 2 samples per group and 6 groups, 12 samples in total.

Tidyverse

www.tidyverse.org

www.tidyverse.org

The tidyverse is a collection of R packages that includes the extremely widely used ggplot2.

     

Tidyverse packages

Tidyverse packages

     

The tidyverse makes data science faster, easier and more fun.

     

Loading the data

We use library() to load in the packages that we need.

library(tidyverse)

The file we will use is a csv comma-separated file, so we will use the read_csv() function from the tidyverse. There is also a read_tsv() function for tab-separated values.

We will use the counts file called GSE60450_GeneLevel_Normalized(CPM.and.TMM)_data.csv that’s in a folder called data i.e. the path to the file should be data/GSE60450_GeneLevel_Normalized(CPM.and.TMM)_data.csv.

We can read the counts file into R with the command below. We’ll store the contents of the counts file in an object called counts. This stores the file contents in R’s memory making it easier to use.

# read in counts file
counts <- read_csv("data/GSE60450_GeneLevel_Normalized(CPM.and.TMM)_data.csv")
Missing column names filled in: 'X1' [1]Parsed with column specification:
cols(
  X1 = col_character(),
  gene_symbol = col_character(),
  GSM1480291 = col_double(),
  GSM1480292 = col_double(),
  GSM1480293 = col_double(),
  GSM1480294 = col_double(),
  GSM1480295 = col_double(),
  GSM1480296 = col_double(),
  GSM1480297 = col_double(),
  GSM1480298 = col_double(),
  GSM1480299 = col_double(),
  GSM1480300 = col_double(),
  GSM1480301 = col_double(),
  GSM1480302 = col_double()
)
# read in metadata
sampleinfo <- read_csv("data/GSE60450_filtered_metadata.csv")
Missing column names filled in: 'X1' [1]Parsed with column specification:
cols(
  X1 = col_character(),
  characteristics = col_character(),
  immunophenotype = col_character(),
  `developmental stage` = col_character()
)

There is some information output by read_csv on “column specification”. It tells us that there is a missing header and it has been filled with the name “X1”. It also tells us what data types read_csv is detecting in each column. Columns with text charactershave been detected (col_character) and also columns with numbers (col_double). We won’t get into the details of data types in this tutorial but they are important to learn about at some stage and you can read more about them in the R for Data Science book.

In R we use <- to assign values to objects. <- is the assignment operator. It assigns values on the right to objects on the left. So to create an object, we need to give it a name (e.g. counts), followed by the assignment operator <-, and the value we want to give it. We can give an object almost any name we want but there are some rules and conventions as described here

We can read in a file from a path on our computer on on the web and use this as the value. Note that we need to put quotes (“”) around file paths.

Assignment operator shortcut

In RStudio, typing Alt + - (push Alt at the same time as the - key) will write <- in a single keystroke in a PC, while typing > Option + - (push Option at the same time as the - key) does the same in a Mac.

The value of counts is the contents of the counts file. There is some information output by read_tsv on column specifications, this is the data type that read_tsv has guessed is contained in each column, we will discuss this more later.

Getting to know the data

When assigning a value to an object, R does not print the value. For example, here we don’t see what’s in the counts or sampleinfo files. But there are ways we can look at the data. We will demonstrate using the sampleinfo object.

We can type the name of the object and this will print the first few lines and some information, such as number of rows.

sampleinfo

We can also use dim() to see the dimensions of an object, the number of rows and columns.

dim(sampleinfo)
[1] 12  4

This show us there are 12 rows and 4 columns.

In the Environment Tab in the top right panel in RStudio we can also see the number of rows and columns in the objects we have in our session.

We can also take a look the first few lines with head(). This shows us the first 6 lines.

head(sampleinfo)

We can look at the last few lines with tail(). This shows us the last 6 lines. This can be useful to check the bottom of the file, that it looks ok.

tail(sampleinfo)

Or we can see the whole file with View().

View(sampleinfo)

In the Environment tab we can see how many rows and columns the object contains and we can click on the icon to view all the contents in a tab. This runs the command View() for us.

We can see all the column names with colnames().

colnames(sampleinfo)
[1] "X1"                  "characteristics"     "immunophenotype"     "developmental stage"

We can access individual columns by name using the $ symbol. For example we can see what’s contained in column X1.

sampleinfo$X1
 [1] "GSM1480291" "GSM1480292" "GSM1480293" "GSM1480294" "GSM1480295" "GSM1480296" "GSM1480297"
 [8] "GSM1480298" "GSM1480299" "GSM1480300" "GSM1480301" "GSM1480302"

If we just wanted to see the first 3 values in the column we can specify this using square brackets.

sampleinfo$X1[1:3]
[1] "GSM1480291" "GSM1480292" "GSM1480293"

Other useful commands for checking data are str() and summary().

str() shows us the structure of our data. It shows us what columns there are, the first few entries, and what data type they are e.g. character or numbers (double or integer).

str(sampleinfo)
Classes ‘tbl_df’, ‘tbl’ and 'data.frame':   12 obs. of  4 variables:
 $ X1                 : chr  "GSM1480291" "GSM1480292" "GSM1480293" "GSM1480294" ...
 $ characteristics    : chr  "mammary gland, luminal cells, virgin" "mammary gland, luminal cells, virgin" "mammary gland, luminal cells, 18.5 day pregnancy" "mammary gland, luminal cells, 18.5 day pregnancy" ...
 $ immunophenotype    : chr  "luminal cell population" "luminal cell population" "luminal cell population" "luminal cell population" ...
 $ developmental stage: chr  "virgin" "virgin" "18.5 day pregnancy" "18.5 day pregnancy" ...
 - attr(*, "spec")=
  .. cols(
  ..   X1 = col_character(),
  ..   characteristics = col_character(),
  ..   immunophenotype = col_character(),
  ..   `developmental stage` = col_character()
  .. )

summary() generates summary statistics of our data. For numeric columns (columns of type double or integer) it outputs statistics such as the min, max, mean and median. We will demonstrate this with the counts file as it contains numeric data. For character columns it shows us the length (how many rows).

summary(counts)
      X1            gene_symbol          GSM1480291          GSM1480292          GSM1480293      
 Length:23735       Length:23735       Min.   :    0.000   Min.   :    0.000   Min.   :    0.00  
 Class :character   Class :character   1st Qu.:    0.000   1st Qu.:    0.000   1st Qu.:    0.00  
 Mode  :character   Mode  :character   Median :    1.745   Median :    1.891   Median :    0.92  
                                       Mean   :   42.132   Mean   :   42.132   Mean   :   42.13  
                                       3rd Qu.:   29.840   3rd Qu.:   29.604   3rd Qu.:   21.91  
                                       Max.   :12525.066   Max.   :12416.211   Max.   :49191.15  
   GSM1480294         GSM1480295          GSM1480296          GSM1480297       
 Min.   :    0.00   Min.   :     0.00   Min.   :     0.00   Min.   :    0.000  
 1st Qu.:    0.00   1st Qu.:     0.00   1st Qu.:     0.00   1st Qu.:    0.000  
 Median :    0.89   Median :     0.58   Median :     0.54   Median :    2.158  
 Mean   :   42.13   Mean   :    42.13   Mean   :    42.13   Mean   :   42.132  
 3rd Qu.:   19.92   3rd Qu.:    12.27   3rd Qu.:    12.28   3rd Qu.:   27.414  
 Max.   :55692.09   Max.   :111850.87   Max.   :108726.08   Max.   :10489.311  
   GSM1480298          GSM1480299          GSM1480300          GSM1480301       
 Min.   :    0.000   Min.   :    0.000   Min.   :    0.000   Min.   :    0.000  
 1st Qu.:    0.000   1st Qu.:    0.000   1st Qu.:    0.000   1st Qu.:    0.000  
 Median :    2.254   Median :    1.854   Median :    1.816   Median :    1.629  
 Mean   :   42.132   Mean   :   42.132   Mean   :   42.132   Mean   :   42.132  
 3rd Qu.:   26.450   3rd Qu.:   24.860   3rd Qu.:   23.443   3rd Qu.:   23.443  
 Max.   :10662.486   Max.   :15194.048   Max.   :17434.935   Max.   :19152.728  
   GSM1480302       
 Min.   :    0.000  
 1st Qu.:    0.000  
 Median :    1.749  
 Mean   :   42.132  
 3rd Qu.:   24.818  
 Max.   :15997.193  

Formatting the data

We will first convert the data from wide format into long format to make it easier to work with and plot with ggplot.

seqdata <- gather(counts, key=Sample, value=Count, starts_with("GSM"))

Let’s have a look at the data.

seqdata

Here we see the function c() for the first time. We use this function extremely often in R when we have multiple items that we are combining. We will see it again in this tutorial.

allinfo <- full_join(seqdata, sampleinfo, by = c("Sample" = "X1"))

Let’s have a look at the data.

allinfo

Plotting with ggplot2

ggplot2 is a plotting package that makes it simple to create complex plots. One really great benefit of ggplot2 versus the older base R plotting is that we only need to make minimal changes if the underlying data change or if we decide to change our plot type, for example, from a box plot to a violin plot. This helps in creating publication quality plots with minimal amounts of adjustments and tweaking.

ggplot2 likes data in the ‘long’ format, i.e., a column for every variable, and a row for every observation, similar to what we created with gather(). Well-structured data will save you lots of time when making figures with ggplot2. We will discuss tidy data more later in the course.

ggplot graphics are built step by step by adding new elements. Adding layers in this fashion allows for extensive flexibility and customization of plots.

To build a ggplot, we use the following basic template that can be used for different types of plots. Three things are required for a ggplot:

  1. The data
  2. The columns in the data we want to map to visual properties (called aesthetics or aes in ggplot2) e.g. the columns for x vlaues, y vales and colours
  3. The type of plot (the geom_)

There are different geoms we can use to create different types of plot e.g. bar plot versus box plot, to see some of the geoms available see the ggplot2 help or the handy ggplot2 cheatsheet.

We can make boxplots to visualise the distribution of the counts for each sample. This helps us to compare the samples and check if any look unusual.

ggplot(data=allinfo, mapping=aes(x=Sample, y=Count)) + 
  geom_boxplot()

We have generated our first plot!

But it looks a bit weird. It’s because we have some genes with extremely high counts. To make it easier to visualise the distributions we usually plot the logarithm of RNA-seq counts. We’ll plot the Sample on the X axis and log2 Counts on the y axis. We can log the Counts within the aes(). (The sample labels are also overlapping each other, we will show how to fix this later)

ggplot(data=allinfo, mapping=aes(x=Sample, y=log2(Count))) + 
  geom_boxplot()

Note that we get a warning here about rows containing non-finite values being removed. This is because some of the genes have a count of zero in the samples and a log of zero is undefined. We can add a small number to every count to avoid the zeros being dropped.

ggplot(data=allinfo, mapping=aes(x=Sample, y=log2(Count + 1))) + 
  geom_boxplot()

The box plots show that the distributions of the samples are not identical but they are not very different.

Box plots are useful summaries, but hide the shape of the distribution. For example, if the distribution is bimodal, we would not see it in a boxplot. An alternative to the boxplot is the violin plot, where the shape (of the density of points) is drawn. See here for an example of how differences in distribution may be hidden in box plots but revealed with violin plots. We could also make jitter plots. A jitter plot is similar to a scatter plot. It adds a small amount of random variation to the location of each point so they don’t overlap. There are too many points in this case for the jitter plots to be useful but this is just to demonstrate, as jitter with and without boxplot is a commonly used ggplot type. We will also make use of jitter plots later.

Exercise

You can easily make different types of plots with ggplot by using different geoms. If you type “geom” in RStudio, RStudio will show you the different types of geoms you can use. Using the same data (same x and y values), try editing the code below to make the plots listed in 1. 2. and 3.

ggplot(data=allinfo, mapping=aes(x=Sample, y=log2(Count + 1), colour=Sample)) + 
  geom_boxplot()

  1. Make a violin plot (geom_violin)
  2. Make a jitter plot (geom_jitter)
  3. Make a boxplot with a jitter plot overlaid (Hint: you can add multiple geoms with + )

What if we would like to add some colour to the plot, for example, a different colour bar for each sample.

If we look at the geom_boxplot help we can see under the heading called “Aesthetics” that there’s an option for colour. Let’s try adding that to our plot. We’ll specify we want to map the Sample column to colour=. As we are mapping colour to a column in our data we need to put this inside the aes().

ggplot(data=allinfo, mapping=aes(x=Sample, y=log2(Count + 1), colour=Sample)) + 
  geom_boxplot()

Hmm colouring the edges wasn’t quite what we had in mind. Look at the help for geom_boxplot to see what other aesthetic we could use. Let’s try fill= instead.

ggplot(data=allinfo, mapping=aes(x=Sample, y=log2(Count + 1), fill=Sample)) + 
  geom_boxplot()

That looks better. fill= is used to fill in areas in ggplot2 plots, whereas colour= is used to colour lines and points.

A really nice feature about ggplot is that we can easily colour by another variable e.g. cell type (basal vs luminal) by simply changing the column we give to fill=.

Exercise

Colour the plots by other variables (columns) in the metadata file:

  1. characteristics
  2. immunophenotype
  3. developmental stage (Check what happens if you don’t use backticks)

Make subplots for each gene

With ggplot we can easily make subplots using faceting. For example we can make stripcharts, plotting expression by the groups (basal virgin, basal pregnant, basal lactating, luminal virgin, luminal pregnant, luminal lactating) for each gene.

First we’ll use mutate() to add a column with shorter group names to use in the plot, as the group names in the characteristics column are quite long.

 allinfo <- mutate(allinfo, Group=case_when(                                        
        str_detect(characteristics, "basal.*virgin") ~ "bvirg",
        str_detect(characteristics, "basal.*preg")  ~ "bpreg",
        str_detect(characteristics, "basal.*lact")  ~ "blact",
        str_detect(characteristics, "luminal.*virgin")  ~ "lvirg",
        str_detect(characteristics, "luminal.*preg")  ~ "lpreg",
        str_detect(characteristics, "luminal.*lact")  ~ "llact"
       ))

Have a look at this data using head(). You should see a new column called Group has been added to the end.

head(allinfo)

We can make plots for a set of genes.

mygenes <- c("Csn1s2a", "Csn1s1", "Csn2", "Glycam1", "COX1", "Trf", "Wap", "Eef1a1")

Note on specifying genes

This example is to demonstrate how we could specify any genes in the data to plot. The genes used here were the 8 genes with the highest counts summed across all samples. The command for how to get the gene symbols for these 8 genes is shown below.
allinfo %>%
group_by(gene_symbol) %>%
summarise(Total_count=sum(Count)) %>%
arrange(desc(Total_count)) %>% head(n=8) %>% pull(gene_symbol)

We filter our data for just these genes of interest.

mygenes_counts <- filter(allinfo, gene_symbol %in% mygenes)

We can make boxplots for just these genes. We facet on the gene_symbol column using facet_wrap(). We add the tilde symbol ~ in front of the column we want to facet on.

ggplot(data=mygenes_counts, mapping=aes(x=Group, y=log2(Count), fill=Group)) +
  geom_boxplot() +
  facet_wrap(~gene_symbol)

Here we only have two values per group so we could just plot the individual points. We could use geom_point to make a scatterplot.

ggplot(data=mygenes_counts, mapping=aes(x=Group, y=Count)) +
  geom_point() +
  facet_wrap(~gene_symbol)

The points are overlapping so we will use geom_jitter which adds a small amount of random variation.

ggplot(data=mygenes_counts, mapping=aes(x=Group, y=Count)) +
  geom_jitter() +
  facet_wrap(~gene_symbol)

We can colour the groups similar to before using colour=.

ggplot(data=mygenes_counts, mapping=aes(x=Group, y=Count, colour=Group)) +
  geom_jitter() +
  facet_wrap(~gene_symbol) 

Modifying the plot

Specifying colours

We might want to change the colours. To see what colour names are available you can type colours(). There is also an R colours cheatsheet that shows what the colours look like.

mycolours <- c("turquoise", "plum", "tomato", "violet", "steelblue", "chocolate")

Then we then add these colours to the plot using a + and scale_colour_manual(values=mycolours).

ggplot(data=mygenes_counts, mapping=aes(x=Group, y=Count, colour=Group)) +
  geom_jitter() +
  facet_wrap(~gene_symbol) +
  scale_colour_manual(values=mycolours)

There are built-in colour palettes that can be handy to use, where the sets of colours are predefined. scale_colour_brewer() is a popular one (there is also scale_fill_brewer()). You can take a look at the help for scale_colour_brewer() to see what palettes are available. The R colours cheatsheet also shows what the colours of the palettes look like. There’s one called “Dark2”, let’s have a look at that.

ggplot(data=mygenes_counts, mapping=aes(x=Group, y=Count, colour=Group)) +
  geom_jitter() +
  facet_wrap(~gene_symbol) +
  scale_colour_brewer(palette = "Dark2")

Exercise

Make a colourblind friendly plot. Hint there are colourblind friendly palettes here

Axis labels and Title

We can change the axis labels and add a title with labs(). To change the x axis label we use labs(x="New name"). To change the y axis label we use labs(y="New name") or we can change them all at the same time.

ggplot(data=mygenes_counts, mapping=aes(x=Group, y=Count, colour=Group)) +
  geom_jitter() +
  facet_wrap(~gene_symbol) + 
  labs(x="Cell type and stage", y="Count", title="Mammary gland RNA-seq data")

Themes

We can adjust the text on the x axis (the group labels by turning them 90 degrees so we can read the labels better.

ggplot(data=mygenes_counts, mapping=aes(x=Group, y=Count, colour=Group)) +
  geom_jitter() +
  facet_wrap(~gene_symbol) + 
  labs(x="Cell type and stage", y="Count", title="Mammary gland RNA-seq data") +
  theme(axis.text.x = element_text(angle = 90))

We can remove the grey background and grid lines. To do this we modify the ggplot theme. Themes are the non-data parts of the plot.

There are also a lot of built-in themes. Let’s have a look at a couple of the more widely used themes. We won’t save these (we won’t use p <-) we’ll just print them to have a look. The default ggplot theme is theme_grey().

ggplot(data=mygenes_counts, mapping=aes(x=Group, y=Count, colour=Group)) +
  geom_jitter() +
  facet_wrap(~gene_symbol) + 
  labs(x="Cell type and stage", y="Count", title="Mammary gland RNA-seq data") +
  theme(axis.text.x = element_text(angle = 90)) + 
  theme_bw()

ggplot(data=mygenes_counts, mapping=aes(x=Group, y=Count, colour=Group)) +
  geom_jitter() +
  facet_wrap(~gene_symbol) + 
  labs(x="Cell type and stage", y="Count", title="Mammary gland RNA-seq data") +
  theme(axis.text.x = element_text(angle = 90)) + 
  theme_minimal()

There are many themes available, you can see some in the R graph gallery.

We can also modify parts of the theme individually. We can remove the grey background and grid lines with the code below.

ggplot(data=mygenes_counts, mapping=aes(x=Group, y=Count, colour=Group)) +
  geom_jitter() +
  facet_wrap(~gene_symbol) + 
  labs(x="Cell type and stage", y="Count", title="Mammary gland RNA-seq data") +
  theme(axis.text.x = element_text(angle = 90)) + 
  theme(panel.background = element_blank(), 
        panel.grid.major = element_blank(), 
        panel.grid.minor = element_blank())

Saving plots

We can save plots interactively by clicking Export in the Plots window. Or we can output plots to pdf using pdf() followed by dev.off(). We put our plot code after the call to pdf() and before closing the plot device with dev.off().

Let’s save our last plot.

pdf("myplot.pdf")
ggplot(data=mygenes_counts, mapping=aes(x=Group, y=Count, colour=Group)) +
  geom_jitter() +
  facet_wrap(~gene_symbol) + 
  labs(x="Cell type and stage", y="Count", title="Mammary gland RNA-seq data") +
  theme(axis.text.x = element_text(angle = 90)) + 
  theme(panel.background = element_blank(), 
        panel.grid.major = element_blank(), 
        panel.grid.minor = element_blank())
dev.off()

Exercises

  1. Download the raw counts for this dataset
  1. Make a boxplot. Do the samples look any different to the normalised counts?
  2. Make subplots for the same set of 8 genes. Do they look any different to the normalised counts?
  1. Download the normalised counts for the GSE63310 dataset from GREIN. Make boxplots colouring the samples using different columns in the metadata file.

Key Points

  • RStudio is an interface that makes it easier to use R.
  • install.packages() is used to install a packages onto your computer, library() is used when you want to use a package in an R script or session
  • read_csv() or read_tsv() can be used to read in csv and tsv files respectively
  • Useful commands for checking data are dim(), head(), tail(), str(), summary(), View()
  • gather() can be used to convert data into long format for ggplot
  • full_join() can be used to join different files
  • ggplot2 is a plotting package that makes it simple to create complex plots and have 3 components: data (dataset), mapping (columns to plot) and geom (type of plot).
  • The + sign is used to add layers. It must be placed at the end of the preceding line. If it is added at the beginning of the line, ggplot2 will return an error message.
  • facet_wrap() can be used to make subplots
  • ggplot2 plots can be easily coloured by columns in the dataset. fill= can be used to colour areas and colour= to colour points and lines
LS0tCnRpdGxlOiAiSW50cm9kdWN0aW9uIHRvIFIgZm9yIEJpb2xvZ2lzdHMiCmF1dGhvcjogIk1hcmlhIERveWxlLCBKZXNzaWNhIENodW5nLCBWaWNreSBQZXJyZWF1IgpvdXRwdXQ6CiAgaHRtbF9ub3RlYm9vazoKICAgIHRvYzogeWVzCiAgICB0b2NfZGVwdGg6IDMKICAgIHRvY19mbG9hdDogeWVzCmRhdGU6ICJgciBmb3JtYXQoU3lzLnRpbWUoKSwgJyVkICVCICVZJylgIgotLS0KCiMgUiBmb3IgQmlvbG9naXN0cyBjb3Vyc2UKClIgdGFrZXMgdGltZSB0byBsZWFybiwgbGlrZSBhIHNwb2tlbiBsYW5ndWFnZS4gTm8gb25lIGNhbiBleHBlY3QgdG8gYmUgYW4gUiBleHBlcnQgYWZ0ZXIgbGVhcm5pbmcgUiBmb3IgYSBmZXcgaG91cnMuIFRoaXMgY291cnNlIGhhcyBiZWVuIGRlc2lnbmVkIHRvIGludHJvZHVjZSBiaW9sb2dpc3RzIHRvIFIsIHNob3dpbmcgc29tZSBiYXNpY3MgYW5kIHNvbWUgcG93ZXJmdWwgdGhpbmdzIFIgY2FuIGRvLiBUaGUgYWltIGlzIHRvIGdpdmUgYmVnaW5uZXJzIHRoZSBjb25maWRlbmNlIHRvIGNvbnRpbnVlIGxlYXJuaW5nIFIsIHNvIHRoZSBmb2N1cyBoZXJlIGlzIG9uIHRpZHl2ZXJzZSBhbmQgdmlzdWFsaXNhdGlvbiBvZiBiaW9sb2dpY2FsIGRhdGEsIGFzIHdlIGJlbGlldmUgdGhpcyBpcyBhIHByb2R1Y3RpdmUgYW5kIGVuZ2FnaW5nIHdheSB0byBzdGFydCBsZWFybmluZyBSLgoKIyBJbnRybyB0byBSIGFuZCBSU3R1ZGlvCgpSU3R1ZGlvIGlzIGFuIGludGVyZmFjZSB0aGF0IG1ha2VzIGl0IGVhc2llciB0byB1c2UgUi4gVGhlcmUgYXJlIGZvdXIgd2luZG93cyBpbiBSU3R1ZGlvLiBUaGUgc2NyZWVuc2hvdCBiZWxvdyBzaG93cyBhbiBbYW5hbG9neSBsaW5raW5nIHRoZSBkaWZmZXJlbnQgUlN0dWRpbyB3aW5kb3dzIHRvIGNvb2tpbmddKGh0dHBzOi8vdHdpdHRlci5jb20vUkxhZGllc05DTC9zdGF0dXMvMTEzODgxMjgyNjkxNzcyNDE2MCkuCgohW10oaW1hZ2VzL3JzdHVkaW9fY29va2luZy5qcGcpCgpcICAKXCAgClwgIAoKIyMgUiBzY3JpcHQgdnMgY29uc29sZQoKVGhlcmUgYXJlIHR3byB3YXlzIHRvIHdvcmsgaW4gUlN0dWRpbyBpbiB0aGUgY29uc29sZSBvciBpbiBhIHNjcmlwdC4gV2UgY2FuIHR5cGUgYSBjb21tYW5kIGluIHRoZSBjb25zb2xlIGFuZCBwcmVzcyBgRW50ZXIvUmV0dXJuYCB0byBydW4gaXQuIFRyeSBydW5uaW5nIHRoZSBjb21tYW5kIGJlbG93IGluIHRoZSBjb25zb2xlLgoKYGBge3J9CjEgKyAxCmBgYAoKT3Igd2UgY2FuIHVzZSBhbiBSIHNjcmlwdC4gVG8gY3JlYXRlIGEgc2NyaXB0LCBmcm9tIHRoZSB0b3AgbWVudSBpbiBSU3R1ZGlvOiBgRmlsZSA+IE5ldyBGaWxlID4gUiBTY3JpcHRgLiBTYXZlIGl0IGFzIGBpbnRyby5SYC4gTm93IHR5cGUgdGhlIGNvbW1hbmQgYmVsb3cgaW4gdGhlIHNjcmlwdC4gVGhpcyB0aW1lIHlvdSB1c2UgYENtZC9DdHJsYCArIGBFbnRlci9SZXR1cm5gLiBUaGlzIHNlbmRzIHRoZSBjb21tbWFuZCB3aGVyZSB0aGUgY3Vyc29yIGlzIGZyb20gdGhlIHNjcmlwdCB0byB0aGUgY29uc29sZS4gWW91IGNhbiBoaWdobGlnaHQgbXVsdGlwbGUgY29tbWFuZHMgYW5kIHRoZW4gcHJlc3MgYENtZC9DdHJsYCArIGBFbnRlci9SZXR1cm5gIHRvIHJ1biB0aGVtIG9uZSBhZnRlciB0aGUgb3RoZXIuCgpgYGB7cn0KMiArIDIKYGBgCgpBcyB0aGUgUlN0dWRpbyBzY3JlZW5zaG90IGFib3ZlIGV4cGxhaW5zLCBpZiB3ZSB3b3JrIGluIHRoZSBjb25zb2xlIHdlIGRvbid0IGhhdmUgYSBnb29kIHJlY29yZCAocmVjaXBlKSBvZiB3aGF0IHdlJ3ZlIGRvbmUuIFdlIGNhbiBzZWUgY29tbWFuZHMgd2UndmUgcnVuIGluIHRoZSBIaXN0b3J5IHBhbmVsICh0b3AgcmlnaHQgd2luZG93KSwgYW5kIHdlIGNhbiBnbyBiYWNrd2FyZHMgYW5kIGZvcndhcmRzIHRocm91Z2ggb3VyIGhpc3RvcnkgaW4gdGhlIGNvbnNvbGUgdXNpbmcgdGhlIHVwIGFycm93IGFuZCBkb3duIGFycm93LiBCdXQgdGhlIGhpc3RvcnkgaW5jbHVkZXMgZXZlcnl0aGluZyB3ZSd2ZSB0cmllZCB0byBydW4sIGluY2x1ZGluZyBvdXIgbWlzdGFrZXMgc28gaXQgaXMgZ29vZCBwcmFjdGljZSB0byB1c2UgYW4gUiBzY3JpcHQuCgpXZSBjYW4gYWxzbyBhZGQgY29tbWVudHMgdG8gYSBzY3JpcHQuIFRoZXNlIGFyZSBub3RlcyB0byBvdXJzZWxmIG9yIG90aGVycyBhYm91dCB0aGUgY29tbWFuZHMgaW4gdGhlIHNjcmlwdC4gQ29tbWVudHMgc3RhcnQgd2l0aCBhIGAjYCB3aGljaCB0ZWxscyBSIG5vdCB0byBydW4gdGhlbSBhcyBjb21tYW5kcy4KCmBgYHtyfQojIHRlc3RpbmcgUgoyICsgMgpgYGAKCiMjIFdvcmtpbmcgZGlyZWN0b3J5CgpPcGVuaW5nIGFuIFJTdHVkaW8gc2Vzc2lvbiBsYXVuY2hlcyBpdCBmcm9tIGEgc3BlY2lmaWMgbG9jYXRpb24uIFRoaXMgaXMgdGhlIOKAmHdvcmtpbmcgZGlyZWN0b3J54oCZLiAqKlIgbG9va3MgaW4gdGhlIHdvcmtpbmcgZGlyZWN0b3J5IGJ5IGRlZmF1bHQgdG8gcmVhZCBpbiBkYXRhIGFuZCBzYXZlIGZpbGVzLioqIFlvdSBjYW4gZmluZCBvdXQgd2hhdCB0aGUgd29ya2luZyBkaXJlY3RvcnkgaXMgYnkgdXNpbmcgdGhlIGNvbW1hbmQgYGdldHdkKClgLiBUaGlzIHNob3dzIHlvdSB0aGUgcGF0aCB0byB5b3VyIHdvcmtpbmcgZGlyZWN0b3J5IGluIHRoZSBjb25zb2xlLiBJbiBNYWMgdGhpcyBpcyBpbiB0aGUgZm9ybWF0IGAvcGF0aC90by93b3JraW5nL2RpcmVjdG9yeWAgYW5kIGluIFdpbmRvd3MgYEM6XHBhdGhcdG9cd29ya2luZ1xkaXJlY3RvcnlgLiBJdCBpcyBvZnRlbiB1c2VmdWwgdG8gaGF2ZSB5b3VyIGRhdGEgYW5kIFIgc2NyaXB0cyBpbiB0aGUgc2FtZSBkaXJlY3RvcnkgYW5kIHNldCB0aGlzIGFzIHlvdXIgd29ya2luZyBkaXJlY3RvcnkuIFdlIHdpbGwgZG8gdGhpcyBub3cuIAoKTWFrZSBhIGZvbGRlciBmb3IgdGhpcyBjb3Vyc2Ugc29tZXdoZXJlIG9uIHlvdXIgY29tcHV0ZXIgdGhhdCB5b3Ugd2lsbCBiZSBhYmxlIHRvIGVhc2lseSBmaW5kLiBOYW1lIHRoZSBmb2xkZXIgZm9yIGV4YW1wbGUsIGBJbnRyb19SX2NvdXJzZWAuIFRoZW4sIHRvIHNldCB0aGlzIGZvbGRlciBhcyB5b3VyIHdvcmtpbmcgZGlyZWN0b3J5OgoKSW4gUlN0dWRpbyBjbGljayBvbiB0aGUg4oCYRmlsZXPigJkgdGFiIGFuZCB0aGVuIGNsaWNrIG9uIHRoZSB0aHJlZSBkb3RzLCBhcyBzaG93biBiZWxvdy4KCiFbXShpbWFnZXMvdGhyZWVfZG90cy5wbmcpCgpJbiB0aGUgd2luZG93IHRoYXQgYXBwZWFycywgZmluZCB0aGUgZm9sZGVyIHlvdSBjcmVhdGVkIChlLmcuIGBJbnRyb19SX2NvdXJzZWApLCBjbGljayBvbiBpdCwgdGhlbiBjbGljayDigJhPcGVu4oCZLiBUaGUgZmlsZXMgdGFiIHdpbGwgbm93IHNob3cgdGhlIGNvbnRlbnRzIG9mIHlvdXIgbmV3IGZvbGRlci4gQ2xpY2sgb24gYE1vcmUgPiBTZXQgQXMgV29ya2luZyBEaXJlY3RvcnlgLCBhcyBzaG93biBiZWxvdy4KCiFbXShpbWFnZXMvd29ya2luZ19kaXJlY3RvcnkucG5nKQoKIyMgUGFja2FnZXMKCklmIGl0J3Mgbm90IGFscmVhZHkgaW5zdGFsbGVkIG9uIHlvdXIgY29tcHV0ZXIsIHlvdSBjYW4gdXNlIHRoZSBgaW5zdGFsbC5wYWNrYWdlc2AgKipmdW5jdGlvbioqIHRvIGluc3RhbGwgYSAqKnBhY2thZ2UqKi4KCmBgYHtyLCBldmFsPUZBTFNFfQppbnN0YWxsLnBhY2thZ2VzKCd0aWR5dmVyc2UnKQpgYGAKCldlIHdpbGwgc2VlIG1hbnkgZnVuY3Rpb25zIGluIHRoaXMgdHV0b3JpYWwuIEZ1bmN0aW9ucyBhcmUgImNhbm5lZCBzY3JpcHRzIiB0aGF0IGF1dG9tYXRlIG1vcmUgY29tcGxpY2F0ZWQgc2V0cyBvZiBjb21tYW5kcy4gTWFueSBmdW5jdGlvbnMgYXJlIHByZWRlZmluZWQsIG9yIGNhbiBiZSBtYWRlIGF2YWlsYWJsZSBieSBpbXBvcnRpbmcgUiBwYWNrYWdlcy4gQSBmdW5jdGlvbiB1c3VhbGx5IHRha2VzIG9uZSBvciBtb3JlIGlucHV0cyBjYWxsZWQgKmFyZ3VtZW50cyouIEhlcmUgdGlkeXZlcnNlIGlzIHRoZSBhcmd1bWVudCB0byB0aGUgYGluc3RhbGwucGFja2FnZXMoKWAgZnVuY3Rpb24uICoqTm90ZSB0aGF0IGZ1bmN0aW9ucyByZXF1aXJlIHBhcmVudGhlc2VzIGFmdGVyIHRoZSBmdW5jdGlvbiBuYW1lLioqCgojIyBHZXR0aW5nIGhlbHAKClRvIHNlZSB3aGF0IGFueSBmdW5jdGlvbiBpbiBSIGRvZXMsIHR5cGUgYSBgP2AgYmVmb3JlIHRoZSBuYW1lIGFuZCBoZWxwIGluZm9ybWF0aW9uIHdpbGwgYXBwZWFyIGluIHRoZSBIZWxwIHBhbmVsIG9uIHRoZSByaWdodCBpbiBSU3R1ZGlvLiBPciB5b3UgY2FuIHNlYXJjaCB0aGUgZnVuY3Rpb24gbmFtZSBpbiB0aGUgSGVscCBwYW5lbCBzZWFyY2ggYm94LiBHb29nbGUgYW5kIFN0YWNrIE92ZXJmbG93IGFyZSBhbHNvIHVzZWZ1bCByZXNvdXJjZXMgZm9yIGdldHRpbmcgaGVscC4KCmBgYHtyLCBldmFsPUZBTFNFfQo/aW5zdGFsbC5wYWNrYWdlcwpgYGAKCj4gIyMjIyBUYWIgY29tcGxldGlvbgo+IEEgdmVyeSB1c2VmdWwgZmVhdHVyZSBpcyBUYWIgY29tcGxldGlvbi4gWW91IGNhbiBzdGFydCB0eXBpbmcgYW5kIHVzZSA8a2JkPlRhYjwva2JkPiB0byBhdXRvY29tcGxldGUgY29kZSwgZm9yIGV4YW1wbGUsIGEgZnVuY3Rpb24gbmFtZS4gCgojIyBDb21tb24gUiBlcnJvcnMKClIgZXJyb3IgbWVzc2FnZXMgYXJlIGNvbW1vbiBhbmQgY2FuIHNvbWV0aW1lcyBiZSBjcnlwdGljLiBZb3UgbW9zdCBsaWtlbHkgd2lsbCBlbmNvdW50ZXIgYXQgbGVhc3Qgb25lIGVycm9yIG1lc3NhZ2UgZHVyaW5nIHRoaXMgdHV0b3JpYWwuIFNvbWUgY29tbW9uIHJlYXNvbnMgZm9yIGVycm9ycyBhcmU6CgotIENhc2Ugc2Vuc2l0aXZpdHkgLSBJbiBSLCBhcyBpbiBvdGhlciBwcm9ncmFtbWluZyBsYW5ndWFnZXMsIGNhc2Ugc2Vuc2l0aXZpdHkgaXMgaW1wb3J0YW50LiA/aW5zdGFsbC5wYWNrYWdlcyBpcyBkaWZmZXJlbnQgdG8gP0luc3RhbGwucGFja2FnZXMuCi0gTWlzc2luZyBjb21tYXMKLSBNaXNtYXRjaGVkIHBhcmVudGhlc2VzIG9yIGJyYWNrZXRzCi0gTm90IHF1b3RpbmcgZmlsZSBwYXRocwoKVG8gc2VlIGV4YW1wbGVzIG9mIHNvbWUgUiBlcnJvciBtZXNzYWdlcyB3aXRoIGV4cGxhbmF0aW9ucyBzZWUgW2hlcmVdKCBodHRwczovL2dpdGh1Yi5jb20vbm9hbXJvc3MvemVyby1kZXBlbmRlbmN5LXByb2JsZW1zL2lzc3Vlcy83KQoKCiMgR2V0dGluZyBzdGFydGVkIHdpdGggZGF0YQoKCiMjIERhdGEgZmlsZXMKVGhlIGRhdGEgZmlsZXMgcmVxdWlyZWQgZm9yIHRoaXMgd29ya3Nob3AgYXJlIGF2YWlsYWJsZSBvbiBbR2l0SHViXShodHRwczovL2dpdGh1Yi5jb20vbWJsdWU5L3ItaW50cm8tYmlvbG9naXN0cy9ibG9iL21hc3Rlci9kYXRhLnppcCkuIFRvIGRvd25sb2FkIHRoZSBkYXRhLnppcCBmaWxlLCBjbGljayB0aGUgJ0Rvd25sb2FkJyBidXR0b24gdGhhdCdzIGluIHRoZSBtaWRkbGUgb2YgdGhlIHBhZ2UuIFVuemlwIHRoZSBmaWxlIGFuZCBzdG9yZSB0aGlzIGBkYXRhYCBmb2xkZXIgaW4geW91ciB3b3JraW5nIGRpcmVjdG9yeS4KCgojIyBHUkVJTiAoR0VPIFJOQS1zZXEgRXhwZXJpbWVudHMgSW50ZXJhY3RpdmUgTmF2aWdhdG9yKSAKSW4gdGhpcyB0dXRvcmlhbCwgd2Ugd2lsbCBsZWFybiBzb21lIFIgdGhyb3VnaCBjcmVhdGluZyBwbG90cyB0byB2aXN1YWxpc2UgZGF0YSBmcm9tIGFuIFJOQS1zZXEgZXhwZXJpbWVudC4gUk5BLXNlcSBjb3VudHMgZmlsZSBjYW4gYmUgb2J0YWluZWQgZnJvbSB0aGUgW0dSRUlOIHBsYXRmb3JtXShodHRwczovL3d3dy5uYXR1cmUuY29tL2FydGljbGVzL3M0MTU5OC0wMTktNDM5MzUtOCkuIEdSRUlOIHByb3ZpZGVzID42LDUwMCBwdWJsaXNoZWQgZGF0YXNldHMgZnJvbSBHRU8gdGhhdCBoYXZlIGJlZW4gdW5pZm9ybWx5IHByb2Nlc3NlZC4gSXQgaXMgYXZhaWxhYmxlIGF0IGh0dHA6Ly93d3cuaWxpbmNzLm9yZy9hcHBzL2dyZWluLy4gWW91IGNhbiBzZWFyY2ggZm9yIGEgZGF0YXNldCBvZiBpbnRlcmVzdCB1c2luZyB0aGUgR0VPIGNvZGUuIFdlIG9idGFpbmVkIHRoZSBkYXRhc2V0IHVzZWQgaGVyZSB1c2luZyB0aGUgY29kZSBHU0U2MDQ1MC4gR1JFSU4gcHJvdmlkZSBRQyBtZXRyaWNzIGZvciB0aGUgUk5BLXNlcSBkYXRhc2V0cyBhbmQgYm90aCByYXcgYW5kIG5vcm1hbGl6ZWQgY291bnRzLiBXZSB3aWxsIHVzZSB0aGUgbm9ybWFsaXplZCBjb3VudHMgaGVyZS4gVGhlc2UgYXJlIHRoZSBjb3VudHMgb2YgcmVhZHMgZm9yIGVhY2ggZ2VuZSBmb3IgZWFjaCBzYW1wbGUgbm9ybWFsaXplZCBmb3IgZGlmZmVyZW5jZXMgaW4gc2VxdWVuY2luZyBkZXB0aCBhbmQgY29tcG9zaXRpb24gYmlhcy4gVGhlIGhpZ2hlciB0aGUgbnVtYmVyIG9mIGNvdW50cyB0aGUgbW9yZSB0aGUgZ2VuZSBpcyBleHByZXNzZWQuClwgIApcIAoKIyMgUk5BLXNlcSBkYXRhc2V0CkhlcmUgd2Ugd2lsbCBjcmVhdGUgc29tZSBwbG90cyB1c2luZyBSTkEtc2VxIGRhdGEgZnJvbSB0aGUgcGFwZXIgYnkgW0Z1IGV0IGFsLiAyMDE1XShodHRwczovL3d3dy5uY2JpLm5sbS5uaWguZ292L3B1Ym1lZC8yNTczMDQ3MiksIEdFTyBjb2RlIEdTRTYwNDUwLiBUaGlzIHN0dWR5IGV4YW1pbmVkIGV4cHJlc3Npb24gaW4gYmFzYWwgYW5kIGx1bWluYWwgY2VsbHMgZnJvbSBtaWNlIGF0IGRpZmZlcmVudCBzdGFnZXMgKHZpcmdpbiwgcHJlZ25hbnQgYW5kIGxhY3RhdGluZykuIFRoZXJlIGFyZSAyIHNhbXBsZXMgcGVyIGdyb3VwIGFuZCA2IGdyb3VwcywgMTIgc2FtcGxlcyBpbiB0b3RhbC4KCiFbXShpbWFnZXMvbW91c2VfZXhwLnBuZykKCiMjIFRpZHl2ZXJzZQoKIVt3d3cudGlkeXZlcnNlLm9yZ10oaW1hZ2VzL3RpZHl2ZXJzZS5wbmcpe3dpZHRoPTEwMCUgfQoKVGhlICoqdGlkeXZlcnNlKiogaXMgYSBjb2xsZWN0aW9uIG9mIFIgcGFja2FnZXMgdGhhdCBpbmNsdWRlcyB0aGUgZXh0cmVtZWx5IHdpZGVseSB1c2VkICoqYGdncGxvdDJgKiouIAoKXCAgClwgIApcICAKCiFbVGlkeXZlcnNlIHBhY2thZ2VzXShpbWFnZXMvdGlkeXZlcnNlX3BhY2thZ2VzLmpwZWcpe3dpZHRoPTUwJSB9CgpcICAKXCAgClwgCgoqKlRoZSBbdGlkeXZlcnNlXShodHRwczovL3d3dy50aWR5dmVyc2Uub3JnLykgbWFrZXMgZGF0YSBzY2llbmNlIGZhc3RlciwgZWFzaWVyIGFuZCBtb3JlIGZ1bi4qKgoKXCAgClwgIApcICAKCgojIyBMb2FkaW5nIHRoZSBkYXRhCgpXZSB1c2UgYGxpYnJhcnkoKWAgdG8gbG9hZCBpbiB0aGUgcGFja2FnZXMgdGhhdCB3ZSBuZWVkLgoKYGBge3IsIG1lc3NhZ2U9RkFMU0V9CmxpYnJhcnkodGlkeXZlcnNlKQpgYGAKClRoZSBmaWxlIHdlIHdpbGwgdXNlIGlzIGEgY3N2IGNvbW1hLXNlcGFyYXRlZCBmaWxlLCBzbyB3ZSB3aWxsIHVzZSB0aGUgYHJlYWRfY3N2KClgIGZ1bmN0aW9uIGZyb20gdGhlIHRpZHl2ZXJzZS4gVGhlcmUgaXMgYWxzbyBhIGByZWFkX3RzdigpYCBmdW5jdGlvbiBmb3IgdGFiLXNlcGFyYXRlZCB2YWx1ZXMuCgpXZSB3aWxsIHVzZSB0aGUgY291bnRzIGZpbGUgY2FsbGVkIGBHU0U2MDQ1MF9HZW5lTGV2ZWxfTm9ybWFsaXplZChDUE0uYW5kLlRNTSlfZGF0YS5jc3ZgIHRoYXQncyBpbiBhIGZvbGRlciBjYWxsZWQgYGRhdGFgIGkuZS4gdGhlIHBhdGggdG8gdGhlIGZpbGUgc2hvdWxkIGJlIGBkYXRhL0dTRTYwNDUwX0dlbmVMZXZlbF9Ob3JtYWxpemVkKENQTS5hbmQuVE1NKV9kYXRhLmNzdmAuCgpXZSBjYW4gcmVhZCB0aGUgY291bnRzIGZpbGUgaW50byBSIHdpdGggdGhlIGNvbW1hbmQgYmVsb3cuIFdlJ2xsIHN0b3JlIHRoZSBjb250ZW50cyBvZiB0aGUgY291bnRzIGZpbGUgaW4gYW4gKipvYmplY3QqKiBjYWxsZWQgYGNvdW50c2AuIFRoaXMgc3RvcmVzIHRoZSBmaWxlIGNvbnRlbnRzIGluIFIncyBtZW1vcnkgbWFraW5nIGl0IGVhc2llciB0byB1c2UuCgpgYGB7cn0KIyByZWFkIGluIGNvdW50cyBmaWxlCmNvdW50cyA8LSByZWFkX2NzdigiZGF0YS9HU0U2MDQ1MF9HZW5lTGV2ZWxfTm9ybWFsaXplZChDUE0uYW5kLlRNTSlfZGF0YS5jc3YiKQoKIyByZWFkIGluIG1ldGFkYXRhCnNhbXBsZWluZm8gPC0gcmVhZF9jc3YoImRhdGEvR1NFNjA0NTBfZmlsdGVyZWRfbWV0YWRhdGEuY3N2IikKYGBgCgpUaGVyZSBpcyBzb21lIGluZm9ybWF0aW9uIG91dHB1dCBieSByZWFkX2NzdiBvbiAiY29sdW1uIHNwZWNpZmljYXRpb24iLiBJdCB0ZWxscyB1cyB0aGF0IHRoZXJlIGlzIGEgbWlzc2luZyBoZWFkZXIgYW5kIGl0IGhhcyBiZWVuIGZpbGxlZCB3aXRoIHRoZSBuYW1lICJYMSIuIEl0IGFsc28gdGVsbHMgdXMgd2hhdCBkYXRhIHR5cGVzIHJlYWRfY3N2IGlzIGRldGVjdGluZyBpbiBlYWNoIGNvbHVtbi4gQ29sdW1ucyB3aXRoIHRleHQgY2hhcmFjdGVyc2hhdmUgYmVlbiBkZXRlY3RlZCAoY29sX2NoYXJhY3RlcikgYW5kIGFsc28gY29sdW1ucyB3aXRoIG51bWJlcnMgKGNvbF9kb3VibGUpLiBXZSB3b24ndCBnZXQgaW50byB0aGUgZGV0YWlscyBvZiBkYXRhIHR5cGVzIGluIHRoaXMgdHV0b3JpYWwgYnV0IHRoZXkgYXJlIGltcG9ydGFudCB0byBsZWFybiBhYm91dCBhdCBzb21lIHN0YWdlIGFuZCB5b3UgY2FuIHJlYWQgbW9yZSBhYm91dCB0aGVtIGluIHRoZSBbUiBmb3IgRGF0YSBTY2llbmNlIGJvb2tdKGh0dHBzOi8vcjRkcy5oYWQuY28ubnovdmVjdG9ycy5odG1sI2ltcG9ydGFudC10eXBlcy1vZi1hdG9taWMtdmVjdG9yKS4KCkluIFIgd2UgdXNlIGA8LWAgdG8gYXNzaWduIHZhbHVlcyB0byBvYmplY3RzLiBgPC1gIGlzIHRoZSAqKmFzc2lnbm1lbnQgb3BlcmF0b3IqKi4gIEl0IGFzc2lnbnMgdmFsdWVzIG9uIHRoZSByaWdodCB0byBvYmplY3RzIG9uIHRoZSBsZWZ0LiBTbyB0byBjcmVhdGUgYW4gb2JqZWN0LCB3ZSBuZWVkIHRvIGdpdmUgaXQgYSBuYW1lIChlLmcuIGBjb3VudHNgKSwgZm9sbG93ZWQgYnkgdGhlIGFzc2lnbm1lbnQgb3BlcmF0b3IgYDwtYCwgYW5kIHRoZSB2YWx1ZSB3ZSB3YW50IHRvIGdpdmUgaXQuIFdlIGNhbiBnaXZlIGFuIG9iamVjdCBhbG1vc3QgYW55IG5hbWUgd2Ugd2FudCBidXQgdGhlcmUgYXJlIHNvbWUgcnVsZXMgYW5kIGNvbnZlbnRpb25zIGFzIGRlc2NyaWJlZCBbaGVyZV0oaHR0cHM6Ly9kYXRhY2FycGVudHJ5Lm9yZy9SLWdlbm9taWNzLzAxLWludHJvLXRvLVIuaHRtbCNub3Rlc19vbl9vYmplY3RzKQoKV2UgY2FuIHJlYWQgaW4gYSBmaWxlIGZyb20gYSBwYXRoIG9uIG91ciBjb21wdXRlciBvbiBvbiB0aGUgd2ViIGFuZCB1c2UgdGhpcyBhcyB0aGUgdmFsdWUuIE5vdGUgdGhhdCB3ZSBuZWVkIHRvIHB1dCBxdW90ZXMgKCIiKSBhcm91bmQgZmlsZSBwYXRocy4KCj4gIyMjIyBBc3NpZ25tZW50IG9wZXJhdG9yIHNob3J0Y3V0Cj4gSW4gUlN0dWRpbywgdHlwaW5nIDxrYmQ+QWx0PC9rYmQ+ICsgPGtiZD4tPC9rYmQ+IChwdXNoIDxrYmQ+QWx0PC9rYmQ+IGF0IHRoZQo+IHNhbWUgdGltZSBhcyB0aGUgPGtiZD4tPC9rYmQ+IGtleSkgd2lsbCB3cml0ZSBgIDwtIGAgaW4gYSBzaW5nbGUga2V5c3Ryb2tlIGluIGEgUEMsIHdoaWxlIHR5cGluZyA+IDxrYmQ+T3B0aW9uPC9rYmQ+ICsgPGtiZD4tPC9rYmQ+IChwdXNoIDxrYmQ+T3B0aW9uPC9rYmQ+IGF0IHRoZQo+IHNhbWUgdGltZSBhcyB0aGUgPGtiZD4tPC9rYmQ+IGtleSkgZG9lcyB0aGUgc2FtZSBpbiBhIE1hYy4gCgpUaGUgdmFsdWUgb2YgYGNvdW50c2AgaXMgdGhlIGNvbnRlbnRzIG9mIHRoZSBjb3VudHMgZmlsZS4gVGhlcmUgaXMgc29tZSBpbmZvcm1hdGlvbiBvdXRwdXQgYnkgYHJlYWRfdHN2YCBvbiBjb2x1bW4gc3BlY2lmaWNhdGlvbnMsIHRoaXMgaXMgdGhlIGRhdGEgdHlwZSB0aGF0IGByZWFkX3RzdmAgaGFzIGd1ZXNzZWQgaXMgY29udGFpbmVkIGluIGVhY2ggY29sdW1uLCB3ZSB3aWxsIGRpc2N1c3MgdGhpcyBtb3JlIGxhdGVyLiAKCiMjIEdldHRpbmcgdG8ga25vdyB0aGUgZGF0YQoKV2hlbiBhc3NpZ25pbmcgYSB2YWx1ZSB0byBhbiBvYmplY3QsIFIgZG9lcyBub3QgcHJpbnQgdGhlIHZhbHVlLiBGb3IgZXhhbXBsZSwgaGVyZSB3ZSBkb24ndCBzZWUgd2hhdCdzIGluIHRoZSBjb3VudHMgb3Igc2FtcGxlaW5mbyBmaWxlcy4gQnV0IHRoZXJlIGFyZSB3YXlzIHdlIGNhbiBsb29rIGF0IHRoZSBkYXRhLiBXZSB3aWxsIGRlbW9uc3RyYXRlIHVzaW5nIHRoZSBgc2FtcGxlaW5mb2Agb2JqZWN0LgoKV2UgY2FuIHR5cGUgdGhlIG5hbWUgb2YgdGhlIG9iamVjdCBhbmQgdGhpcyB3aWxsIHByaW50IHRoZSBmaXJzdCBmZXcgbGluZXMgYW5kIHNvbWUgaW5mb3JtYXRpb24sIHN1Y2ggYXMgbnVtYmVyIG9mIHJvd3MuIAoKYGBge3J9CnNhbXBsZWluZm8KYGBgCgpXZSBjYW4gYWxzbyB1c2UgYGRpbSgpYCB0byBzZWUgdGhlIGRpbWVuc2lvbnMgb2YgYW4gb2JqZWN0LCB0aGUgbnVtYmVyIG9mIHJvd3MgYW5kIGNvbHVtbnMuCgpgYGB7cn0KZGltKHNhbXBsZWluZm8pCmBgYAoKVGhpcyBzaG93IHVzIHRoZXJlIGFyZSAxMiByb3dzIGFuZCA0IGNvbHVtbnMuCgpJbiB0aGUgRW52aXJvbm1lbnQgVGFiIGluIHRoZSB0b3AgcmlnaHQgcGFuZWwgaW4gUlN0dWRpbyB3ZSBjYW4gYWxzbyBzZWUgdGhlIG51bWJlciBvZiByb3dzIGFuZCBjb2x1bW5zIGluIHRoZSBvYmplY3RzIHdlIGhhdmUgaW4gb3VyIHNlc3Npb24uCgpXZSBjYW4gYWxzbyB0YWtlIGEgbG9vayB0aGUgZmlyc3QgZmV3IGxpbmVzIHdpdGggYGhlYWQoKWAuIFRoaXMgc2hvd3MgdXMgdGhlIGZpcnN0IDYgbGluZXMuCgpgYGB7cn0KaGVhZChzYW1wbGVpbmZvKQpgYGAKCldlIGNhbiBsb29rIGF0IHRoZSBsYXN0IGZldyBsaW5lcyB3aXRoIGB0YWlsKClgLiBUaGlzIHNob3dzIHVzIHRoZSBsYXN0IDYgbGluZXMuIFRoaXMgY2FuIGJlIHVzZWZ1bCB0byBjaGVjayB0aGUgYm90dG9tIG9mIHRoZSBmaWxlLCB0aGF0IGl0IGxvb2tzIG9rLgpgYGB7cn0KdGFpbChzYW1wbGVpbmZvKQpgYGAKCk9yIHdlIGNhbiBzZWUgdGhlIHdob2xlIGZpbGUgd2l0aCBgVmlldygpYC4KCmBgYHtyIGV2YWw9RkFMU0V9ClZpZXcoc2FtcGxlaW5mbykKYGBgCgpJbiB0aGUgRW52aXJvbm1lbnQgdGFiIHdlIGNhbiBzZWUgaG93IG1hbnkgcm93cyBhbmQgY29sdW1ucyB0aGUgb2JqZWN0IGNvbnRhaW5zIGFuZCB3ZSBjYW4gY2xpY2sgb24gdGhlIGljb24gdG8gdmlldyBhbGwgdGhlIGNvbnRlbnRzIGluIGEgdGFiLiBUaGlzIHJ1bnMgdGhlIGNvbW1hbmQgVmlldygpIGZvciB1cy4KCldlIGNhbiBzZWUgYWxsIHRoZSBjb2x1bW4gbmFtZXMgd2l0aCBgY29sbmFtZXMoKWAuCmBgYHtyfQpjb2xuYW1lcyhzYW1wbGVpbmZvKQpgYGAKCldlIGNhbiBhY2Nlc3MgaW5kaXZpZHVhbCBjb2x1bW5zIGJ5IG5hbWUgdXNpbmcgdGhlIGAkYCBzeW1ib2wuIEZvciBleGFtcGxlIHdlIGNhbiBzZWUgd2hhdCdzIGNvbnRhaW5lZCBpbiBjb2x1bW4gWDEuCgpgYGB7cn0Kc2FtcGxlaW5mbyRYMQpgYGAKCklmIHdlIGp1c3Qgd2FudGVkIHRvIHNlZSB0aGUgZmlyc3QgMyB2YWx1ZXMgaW4gdGhlIGNvbHVtbiB3ZSBjYW4gc3BlY2lmeSB0aGlzIHVzaW5nIHNxdWFyZSBicmFja2V0cy4KCmBgYHtyfQpzYW1wbGVpbmZvJFgxWzE6M10KYGBgCgpPdGhlciB1c2VmdWwgY29tbWFuZHMgZm9yIGNoZWNraW5nIGRhdGEgYXJlIGBzdHIoKWAgYW5kIGBzdW1tYXJ5KClgLgoKYHN0cigpYCBzaG93cyB1cyB0aGUgc3RydWN0dXJlIG9mIG91ciBkYXRhLiBJdCBzaG93cyB1cyB3aGF0IGNvbHVtbnMgdGhlcmUgYXJlLCB0aGUgZmlyc3QgZmV3IGVudHJpZXMsIGFuZCB3aGF0IGRhdGEgdHlwZSB0aGV5IGFyZSBlLmcuIGNoYXJhY3RlciBvciBudW1iZXJzIChkb3VibGUgb3IgaW50ZWdlcikuCgpgYGB7cn0Kc3RyKHNhbXBsZWluZm8pCmBgYAoKYHN1bW1hcnkoKWAgZ2VuZXJhdGVzIHN1bW1hcnkgc3RhdGlzdGljcyBvZiBvdXIgZGF0YS4gRm9yIG51bWVyaWMgY29sdW1ucyAoY29sdW1ucyBvZiB0eXBlIGRvdWJsZSBvciBpbnRlZ2VyKSBpdCBvdXRwdXRzIHN0YXRpc3RpY3Mgc3VjaCBhcyB0aGUgbWluLCBtYXgsIG1lYW4gYW5kIG1lZGlhbi4gV2Ugd2lsbCBkZW1vbnN0cmF0ZSB0aGlzIHdpdGggdGhlIGNvdW50cyBmaWxlIGFzIGl0IGNvbnRhaW5zIG51bWVyaWMgZGF0YS4gRm9yIGNoYXJhY3RlciBjb2x1bW5zIGl0IHNob3dzIHVzIHRoZSBsZW5ndGggKGhvdyBtYW55IHJvd3MpLgoKYGBge3J9CnN1bW1hcnkoY291bnRzKQpgYGAKCgojIEZvcm1hdHRpbmcgdGhlIGRhdGEKCldlIHdpbGwgZmlyc3QgY29udmVydCB0aGUgZGF0YSBmcm9tIHdpZGUgZm9ybWF0IGludG8gbG9uZyBmb3JtYXQgdG8gbWFrZSBpdCBlYXNpZXIgdG8gd29yayB3aXRoIGFuZCBwbG90IHdpdGggZ2dwbG90LgoKIVtdKGltYWdlcy9yZXNoYXBlX2RhdGEucG5nKQoKYGBge3J9CnNlcWRhdGEgPC0gZ2F0aGVyKGNvdW50cywga2V5PVNhbXBsZSwgdmFsdWU9Q291bnQsIHN0YXJ0c193aXRoKCJHU00iKSkKYGBgCgpMZXQncyBoYXZlIGEgbG9vayBhdCB0aGUgZGF0YS4KYGBge3J9CnNlcWRhdGEKYGBgCgohW10oaW1hZ2VzL2pvaW5fZGF0YS5wbmcpCgpIZXJlIHdlIHNlZSB0aGUgZnVuY3Rpb24gYGMoKWAgZm9yIHRoZSBmaXJzdCB0aW1lLiBXZSB1c2UgdGhpcyBmdW5jdGlvbiBleHRyZW1lbHkgb2Z0ZW4gaW4gUiB3aGVuIHdlIGhhdmUgbXVsdGlwbGUgaXRlbXMgdGhhdCB3ZSBhcmUgKmNvbWJpbmluZyouIFdlIHdpbGwgc2VlIGl0IGFnYWluIGluIHRoaXMgdHV0b3JpYWwuCgpgYGB7cn0KYWxsaW5mbyA8LSBmdWxsX2pvaW4oc2VxZGF0YSwgc2FtcGxlaW5mbywgYnkgPSBjKCJTYW1wbGUiID0gIlgxIikpCmBgYAoKTGV0J3MgaGF2ZSBhIGxvb2sgYXQgdGhlIGRhdGEuCmBgYHtyfQphbGxpbmZvCmBgYAoKIyBQbG90dGluZyB3aXRoICoqYGdncGxvdDJgKioKCioqYGdncGxvdDJgKiogaXMgYSBwbG90dGluZyBwYWNrYWdlIHRoYXQgbWFrZXMgaXQgc2ltcGxlIHRvIGNyZWF0ZSBjb21wbGV4IHBsb3RzLiBPbmUgcmVhbGx5IGdyZWF0IGJlbmVmaXQgb2YgZ2dwbG90MiB2ZXJzdXMgdGhlIG9sZGVyIGJhc2UgUiBwbG90dGluZyBpcyB0aGF0IHdlIG9ubHkgbmVlZCB0byBtYWtlIG1pbmltYWwgY2hhbmdlcyBpZiB0aGUgdW5kZXJseWluZyBkYXRhIGNoYW5nZSBvciBpZiB3ZSBkZWNpZGUgdG8gY2hhbmdlIG91ciBwbG90IHR5cGUsIGZvciBleGFtcGxlLCBmcm9tIGEgYm94IHBsb3QgdG8gYSB2aW9saW4gcGxvdC4gVGhpcyBoZWxwcyBpbiBjcmVhdGluZyBwdWJsaWNhdGlvbiBxdWFsaXR5IHBsb3RzIHdpdGggbWluaW1hbCBhbW91bnRzIG9mIGFkanVzdG1lbnRzIGFuZCB0d2Vha2luZy4KCioqYGdncGxvdDJgKiogbGlrZXMgZGF0YSBpbiB0aGUgJ2xvbmcnIGZvcm1hdCwgaS5lLiwgYSBjb2x1bW4gZm9yIGV2ZXJ5IHZhcmlhYmxlLCBhbmQgYSByb3cgZm9yIGV2ZXJ5IG9ic2VydmF0aW9uLCBzaW1pbGFyIHRvIHdoYXQgd2UgY3JlYXRlZCB3aXRoIGBnYXRoZXIoKWAuIFdlbGwtc3RydWN0dXJlZCBkYXRhIHdpbGwgc2F2ZSB5b3UgbG90cyBvZiB0aW1lIHdoZW4gbWFraW5nIGZpZ3VyZXMgd2l0aCAqKmBnZ3Bsb3QyYCoqLiBXZSB3aWxsIGRpc2N1c3MgdGlkeSBkYXRhIG1vcmUgbGF0ZXIgaW4gdGhlIGNvdXJzZS4KCmdncGxvdCBncmFwaGljcyBhcmUgYnVpbHQgc3RlcCBieSBzdGVwIGJ5IGFkZGluZyBuZXcgZWxlbWVudHMuIEFkZGluZyBsYXllcnMgaW4gdGhpcyBmYXNoaW9uIGFsbG93cyBmb3IgZXh0ZW5zaXZlIGZsZXhpYmlsaXR5IGFuZCBjdXN0b21pemF0aW9uIG9mIHBsb3RzLgoKVG8gYnVpbGQgYSBnZ3Bsb3QsIHdlIHVzZSB0aGUgZm9sbG93aW5nIGJhc2ljIHRlbXBsYXRlIHRoYXQgY2FuIGJlIHVzZWQgZm9yIGRpZmZlcmVudCB0eXBlcyBvZiBwbG90cy4gVGhyZWUgdGhpbmdzIGFyZSByZXF1aXJlZCBmb3IgYSBnZ3Bsb3Q6CgohW10oaW1hZ2VzL2dncGxvdF90ZW1wbGF0ZS5wbmcpCgoxLiBUaGUgZGF0YQoyLiBUaGUgY29sdW1ucyBpbiB0aGUgZGF0YSB3ZSB3YW50IHRvIG1hcCB0byB2aXN1YWwgcHJvcGVydGllcyAoY2FsbGVkIGFlc3RoZXRpY3Mgb3IgYWVzIGluIGdncGxvdDIpIGUuZy4gdGhlIGNvbHVtbnMgZm9yIHggdmxhdWVzLCB5IHZhbGVzIGFuZCBjb2xvdXJzCjMuIFRoZSB0eXBlIG9mIHBsb3QgKHRoZSBnZW9tXykKClRoZXJlIGFyZSBkaWZmZXJlbnQgZ2VvbXMgd2UgY2FuIHVzZSB0byBjcmVhdGUgZGlmZmVyZW50IHR5cGVzIG9mIHBsb3QgZS5nLiBiYXIgcGxvdCB2ZXJzdXMgYm94IHBsb3QsIHRvIHNlZSBzb21lIG9mIHRoZSBnZW9tcyBhdmFpbGFibGUgc2VlIHRoZSBnZ3Bsb3QyIGhlbHAgb3IgdGhlIGhhbmR5IFtnZ3Bsb3QyIGNoZWF0c2hlZXRdKGh0dHBzOi8vZ2l0aHViLmNvbS9yc3R1ZGlvL2NoZWF0c2hlZXRzL3Jhdy9tYXN0ZXIvZGF0YS12aXN1YWxpemF0aW9uLTIuMS5wZGYpLgoKV2UgY2FuIG1ha2UgYm94cGxvdHMgdG8gdmlzdWFsaXNlIHRoZSBkaXN0cmlidXRpb24gb2YgdGhlIGNvdW50cyBmb3IgZWFjaCBzYW1wbGUuIFRoaXMgaGVscHMgdXMgdG8gY29tcGFyZSB0aGUgc2FtcGxlcyBhbmQgY2hlY2sgaWYgYW55IGxvb2sgdW51c3VhbC4KCmBgYHtyfQpnZ3Bsb3QoZGF0YT1hbGxpbmZvLCBtYXBwaW5nPWFlcyh4PVNhbXBsZSwgeT1Db3VudCkpICsgCiAgZ2VvbV9ib3hwbG90KCkKYGBgCgpXZSBoYXZlIGdlbmVyYXRlZCBvdXIgZmlyc3QgcGxvdCEKCkJ1dCBpdCBsb29rcyBhIGJpdCB3ZWlyZC4gSXQncyBiZWNhdXNlIHdlIGhhdmUgc29tZSBnZW5lcyB3aXRoIGV4dHJlbWVseSBoaWdoIGNvdW50cy4gVG8gbWFrZSBpdCBlYXNpZXIgdG8gdmlzdWFsaXNlIHRoZSBkaXN0cmlidXRpb25zIHdlIHVzdWFsbHkgcGxvdCB0aGUgbG9nYXJpdGhtIG9mIFJOQS1zZXEgY291bnRzLiBXZSdsbCBwbG90IHRoZSBTYW1wbGUgb24gdGhlIFggYXhpcyBhbmQgbG9nfjJ+IENvdW50cyBvbiB0aGUgeSBheGlzLiBXZSBjYW4gbG9nIHRoZSBDb3VudHMgd2l0aGluIHRoZSBgYWVzKClgLiAoVGhlIHNhbXBsZSBsYWJlbHMgYXJlIGFsc28gb3ZlcmxhcHBpbmcgZWFjaCBvdGhlciwgd2Ugd2lsbCBzaG93IGhvdyB0byBmaXggdGhpcyBsYXRlcikKCmBgYHtyfQpnZ3Bsb3QoZGF0YT1hbGxpbmZvLCBtYXBwaW5nPWFlcyh4PVNhbXBsZSwgeT1sb2cyKENvdW50KSkpICsgCiAgZ2VvbV9ib3hwbG90KCkKYGBgCgpOb3RlIHRoYXQgd2UgZ2V0IGEgd2FybmluZyBoZXJlIGFib3V0IHJvd3MgY29udGFpbmluZyBub24tZmluaXRlIHZhbHVlcyBiZWluZyByZW1vdmVkLiBUaGlzIGlzIGJlY2F1c2Ugc29tZSBvZiB0aGUgZ2VuZXMgaGF2ZSBhIGNvdW50IG9mIHplcm8gaW4gdGhlIHNhbXBsZXMgYW5kIGEgbG9nIG9mIHplcm8gaXMgdW5kZWZpbmVkLiBXZSBjYW4gYWRkIGEgc21hbGwgbnVtYmVyIHRvIGV2ZXJ5IGNvdW50IHRvIGF2b2lkIHRoZSB6ZXJvcyBiZWluZyBkcm9wcGVkLgoKYGBge3J9CmdncGxvdChkYXRhPWFsbGluZm8sIG1hcHBpbmc9YWVzKHg9U2FtcGxlLCB5PWxvZzIoQ291bnQgKyAxKSkpICsgCiAgZ2VvbV9ib3hwbG90KCkKYGBgCgpUaGUgYm94IHBsb3RzIHNob3cgdGhhdCB0aGUgZGlzdHJpYnV0aW9ucyBvZiB0aGUgc2FtcGxlcyBhcmUgbm90IGlkZW50aWNhbCBidXQgdGhleSBhcmUgbm90IHZlcnkgZGlmZmVyZW50LgoKQm94IHBsb3RzIGFyZSB1c2VmdWwgc3VtbWFyaWVzLCBidXQgaGlkZSB0aGUgc2hhcGUgb2YgdGhlIGRpc3RyaWJ1dGlvbi4gRm9yIGV4YW1wbGUsIGlmIHRoZSBkaXN0cmlidXRpb24gaXMgYmltb2RhbCwgd2Ugd291bGQgbm90IHNlZSBpdCBpbiBhIGJveHBsb3QuIEFuIGFsdGVybmF0aXZlIHRvIHRoZSBib3hwbG90IGlzIHRoZSAqKnZpb2xpbiBwbG90KiosIHdoZXJlIHRoZSBzaGFwZSAob2YgdGhlIGRlbnNpdHkgb2YgcG9pbnRzKSBpcyBkcmF3bi4gU2VlIGhlcmUgZm9yIGFuIGV4YW1wbGUgb2YgaG93IGRpZmZlcmVuY2VzIGluIGRpc3RyaWJ1dGlvbiBtYXkgYmUgaGlkZGVuIGluIGJveCBwbG90cyBidXQgcmV2ZWFsZWQgd2l0aCB2aW9saW4gcGxvdHMuIFdlIGNvdWxkIGFsc28gbWFrZSBqaXR0ZXIgcGxvdHMuIEEgKipqaXR0ZXIgcGxvdCoqIGlzIHNpbWlsYXIgdG8gYSBzY2F0dGVyIHBsb3QuIEl0IGFkZHMgYSBzbWFsbCBhbW91bnQgb2YgcmFuZG9tIHZhcmlhdGlvbiB0byB0aGUgbG9jYXRpb24gb2YgZWFjaCBwb2ludCBzbyB0aGV5IGRvbuKAmXQgb3ZlcmxhcC4gVGhlcmUgYXJlIHRvbyBtYW55IHBvaW50cyBpbiB0aGlzIGNhc2UgZm9yIHRoZSBqaXR0ZXIgcGxvdHMgdG8gYmUgdXNlZnVsIGJ1dCB0aGlzIGlzIGp1c3QgdG8gZGVtb25zdHJhdGUsIGFzIFtqaXR0ZXIgd2l0aCBhbmQgd2l0aG91dCBib3hwbG90XShodHRwczovL3NpbXBseXN0YXRpc3RpY3Mub3JnLzIwMTkvMDIvMjEvZHluYW1pdGUtcGxvdHMtbXVzdC1kaWUvKSBpcyBhIGNvbW1vbmx5IHVzZWQgZ2dwbG90IHR5cGUuIFdlIHdpbGwgYWxzbyBtYWtlIHVzZSBvZiBqaXR0ZXIgcGxvdHMgbGF0ZXIuCgojIyMjIEV4ZXJjaXNlIApZb3UgY2FuIGVhc2lseSBtYWtlIGRpZmZlcmVudCB0eXBlcyBvZiBwbG90cyB3aXRoIGdncGxvdCBieSB1c2luZyBkaWZmZXJlbnQgZ2VvbXMuIElmIHlvdSB0eXBlICJnZW9tIiBpbiBSU3R1ZGlvLCBSU3R1ZGlvIHdpbGwgc2hvdyB5b3UgdGhlIGRpZmZlcmVudCB0eXBlcyBvZiBnZW9tcyB5b3UgY2FuIHVzZS4gVXNpbmcgdGhlIHNhbWUgZGF0YSAoc2FtZSB4IGFuZCB5IHZhbHVlcyksIHRyeSBlZGl0aW5nIHRoZSBjb2RlIGJlbG93IHRvIG1ha2UgdGhlIHBsb3RzIGxpc3RlZCBpbiAxLiAyLiBhbmQgMy4KCmBgYHtyfQpnZ3Bsb3QoZGF0YT1hbGxpbmZvLCBtYXBwaW5nPWFlcyh4PVNhbXBsZSwgeT1sb2cyKENvdW50ICsgMSksIGNvbG91cj1TYW1wbGUpKSArIAogIGdlb21fYm94cGxvdCgpCmBgYAoKMS4gTWFrZSBhIHZpb2xpbiBwbG90IChnZW9tX3Zpb2xpbikKMi4gTWFrZSBhIGppdHRlciBwbG90IChnZW9tX2ppdHRlcikKMy4gTWFrZSBhIGJveHBsb3Qgd2l0aCBhIGppdHRlciBwbG90IG92ZXJsYWlkIChIaW50OiB5b3UgY2FuIGFkZCBtdWx0aXBsZSBnZW9tcyB3aXRoICsgKQoKCldoYXQgaWYgd2Ugd291bGQgbGlrZSB0byBhZGQgc29tZSBjb2xvdXIgdG8gdGhlIHBsb3QsIGZvciBleGFtcGxlLCBhIGRpZmZlcmVudCBjb2xvdXIgYmFyIGZvciBlYWNoIHNhbXBsZS4gCgpJZiB3ZSBsb29rIGF0IHRoZSBgZ2VvbV9ib3hwbG90YCBoZWxwIHdlIGNhbiBzZWUgdW5kZXIgdGhlIGhlYWRpbmcgY2FsbGVkICJBZXN0aGV0aWNzIiB0aGF0IHRoZXJlJ3MgYW4gb3B0aW9uIGZvciBjb2xvdXIuIExldCdzIHRyeSBhZGRpbmcgdGhhdCB0byBvdXIgcGxvdC4gV2UnbGwgc3BlY2lmeSB3ZSB3YW50IHRvIG1hcCB0aGUgU2FtcGxlIGNvbHVtbiB0byBgY29sb3VyPWAuIEFzIHdlIGFyZSBtYXBwaW5nIGNvbG91ciB0byBhIGNvbHVtbiBpbiBvdXIgZGF0YSB3ZSBuZWVkIHRvIHB1dCB0aGlzIGluc2lkZSB0aGUgYGFlcygpYC4KCmBgYHtyfQpnZ3Bsb3QoZGF0YT1hbGxpbmZvLCBtYXBwaW5nPWFlcyh4PVNhbXBsZSwgeT1sb2cyKENvdW50ICsgMSksIGNvbG91cj1TYW1wbGUpKSArIAogIGdlb21fYm94cGxvdCgpCmBgYAoKSG1tIGNvbG91cmluZyB0aGUgZWRnZXMgd2FzbuKAmXQgcXVpdGUgd2hhdCB3ZSBoYWQgaW4gbWluZC4gTG9vayBhdCB0aGUgaGVscCBmb3IgYGdlb21fYm94cGxvdGAgdG8gc2VlIHdoYXQgb3RoZXIgYWVzdGhldGljIHdlIGNvdWxkIHVzZS4gTGV0J3MgdHJ5IGBmaWxsPWAgaW5zdGVhZC4KCmBgYHtyfQpnZ3Bsb3QoZGF0YT1hbGxpbmZvLCBtYXBwaW5nPWFlcyh4PVNhbXBsZSwgeT1sb2cyKENvdW50ICsgMSksIGZpbGw9U2FtcGxlKSkgKyAKICBnZW9tX2JveHBsb3QoKQpgYGAKClRoYXQgbG9va3MgYmV0dGVyLiBgZmlsbD1gIGlzIHVzZWQgdG8gKipmaWxsKiogaW4gYXJlYXMgaW4gZ2dwbG90MiBwbG90cywgd2hlcmVhcyBgY29sb3VyPWAgaXMgdXNlZCB0byBjb2xvdXIgbGluZXMgYW5kIHBvaW50cy4KCkEgcmVhbGx5IG5pY2UgZmVhdHVyZSBhYm91dCBnZ3Bsb3QgaXMgdGhhdCB3ZSBjYW4gZWFzaWx5IGNvbG91ciBieSBhbm90aGVyIHZhcmlhYmxlIGUuZy4gY2VsbCB0eXBlIChiYXNhbCB2cyBsdW1pbmFsKSBieSBzaW1wbHkgY2hhbmdpbmcgdGhlIGNvbHVtbiB3ZSBnaXZlIHRvIGBmaWxsPWAuCgojIyMjIEV4ZXJjaXNlIApDb2xvdXIgdGhlIHBsb3RzIGJ5IG90aGVyIHZhcmlhYmxlcyAoY29sdW1ucykgaW4gdGhlIG1ldGFkYXRhIGZpbGU6CgoxLiBjaGFyYWN0ZXJpc3RpY3MKMi4gaW1tdW5vcGhlbm90eXBlCjMuIGBgZGV2ZWxvcG1lbnRhbCBzdGFnZWBgIChDaGVjayB3aGF0IGhhcHBlbnMgaWYgeW91IGRvbid0IHVzZSBiYWNrdGlja3MpCgoKIyBNYWtlIHN1YnBsb3RzIGZvciBlYWNoIGdlbmUKCldpdGggZ2dwbG90IHdlIGNhbiBlYXNpbHkgbWFrZSBzdWJwbG90cyB1c2luZyAqZmFjZXRpbmcqLiBGb3IgZXhhbXBsZSB3ZSBjYW4gbWFrZSBzdHJpcGNoYXJ0cywgcGxvdHRpbmcgZXhwcmVzc2lvbiBieSB0aGUgZ3JvdXBzIChiYXNhbCB2aXJnaW4sIGJhc2FsIHByZWduYW50LCBiYXNhbCBsYWN0YXRpbmcsIGx1bWluYWwgdmlyZ2luLCBsdW1pbmFsIHByZWduYW50LCBsdW1pbmFsIGxhY3RhdGluZykgZm9yIGVhY2ggZ2VuZS4gCgpGaXJzdCB3ZSdsbCB1c2UgYG11dGF0ZSgpYCB0byBhZGQgYSBjb2x1bW4gd2l0aCBzaG9ydGVyIGdyb3VwIG5hbWVzIHRvIHVzZSBpbiB0aGUgcGxvdCwgYXMgdGhlIGdyb3VwIG5hbWVzIGluIHRoZSBjaGFyYWN0ZXJpc3RpY3MgY29sdW1uIGFyZSBxdWl0ZSBsb25nLgoKYGBge3J9CiBhbGxpbmZvIDwtIG11dGF0ZShhbGxpbmZvLCBHcm91cD1jYXNlX3doZW4oICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIAogICAgICAgIHN0cl9kZXRlY3QoY2hhcmFjdGVyaXN0aWNzLCAiYmFzYWwuKnZpcmdpbiIpIH4gImJ2aXJnIiwKICAgICAgICBzdHJfZGV0ZWN0KGNoYXJhY3RlcmlzdGljcywgImJhc2FsLipwcmVnIikgIH4gImJwcmVnIiwKICAgICAgICBzdHJfZGV0ZWN0KGNoYXJhY3RlcmlzdGljcywgImJhc2FsLipsYWN0IikgIH4gImJsYWN0IiwKICAgICAgICBzdHJfZGV0ZWN0KGNoYXJhY3RlcmlzdGljcywgImx1bWluYWwuKnZpcmdpbiIpICB+ICJsdmlyZyIsCiAgICAgICAgc3RyX2RldGVjdChjaGFyYWN0ZXJpc3RpY3MsICJsdW1pbmFsLipwcmVnIikgIH4gImxwcmVnIiwKICAgICAgICBzdHJfZGV0ZWN0KGNoYXJhY3RlcmlzdGljcywgImx1bWluYWwuKmxhY3QiKSAgfiAibGxhY3QiCiAgICAgICApKQpgYGAKCkhhdmUgYSBsb29rIGF0IHRoaXMgZGF0YSB1c2luZyBgaGVhZCgpYC4gWW91IHNob3VsZCBzZWUgYSBuZXcgY29sdW1uIGNhbGxlZCBgR3JvdXBgIGhhcyBiZWVuIGFkZGVkIHRvIHRoZSBlbmQuCgpgYGB7cn0KaGVhZChhbGxpbmZvKQpgYGAKCldlIGNhbiBtYWtlIHBsb3RzIGZvciBhIHNldCBvZiBnZW5lcy4KCmBgYHtyfQpteWdlbmVzIDwtIGMoIkNzbjFzMmEiLCAiQ3NuMXMxIiwgIkNzbjIiLCAiR2x5Y2FtMSIsICJDT1gxIiwgIlRyZiIsICJXYXAiLCAiRWVmMWExIikKYGBgCgo+ICMjIyMgTm90ZSBvbiBzcGVjaWZ5aW5nIGdlbmVzCj4gVGhpcyBleGFtcGxlIGlzIHRvIGRlbW9uc3RyYXRlIGhvdyB3ZSBjb3VsZCBzcGVjaWZ5IGFueSBnZW5lcyBpbiB0aGUgZGF0YSB0byBwbG90LiBUaGUgZ2VuZXMgdXNlZCBoZXJlIHdlcmUgdGhlIDggZ2VuZXMgd2l0aCB0aGUgaGlnaGVzdCBjb3VudHMgc3VtbWVkIGFjcm9zcyBhbGwgc2FtcGxlcy4gVGhlIGNvbW1hbmQgZm9yIGhvdyB0byBnZXQgdGhlIGdlbmUgc3ltYm9scyBmb3IgdGhlc2UgOCBnZW5lcyBpcyBzaG93biBiZWxvdy4gIAo+YWxsaW5mbyAlPiUgIAo+ICBncm91cF9ieShnZW5lX3N5bWJvbCkgJT4lICAKPiAgc3VtbWFyaXNlKFRvdGFsX2NvdW50PXN1bShDb3VudCkpICU+JSAgCj4gIGFycmFuZ2UoZGVzYyhUb3RhbF9jb3VudCkpICU+JSAKPiAgaGVhZChuPTgpICU+JSAKPiAgcHVsbChnZW5lX3N5bWJvbCkgCgpXZSBmaWx0ZXIgb3VyIGRhdGEgZm9yIGp1c3QgdGhlc2UgZ2VuZXMgb2YgaW50ZXJlc3QuCgpgYGB7cn0KbXlnZW5lc19jb3VudHMgPC0gZmlsdGVyKGFsbGluZm8sIGdlbmVfc3ltYm9sICVpbiUgbXlnZW5lcykKYGBgCgoKV2UgY2FuIG1ha2UgYm94cGxvdHMgZm9yIGp1c3QgdGhlc2UgZ2VuZXMuIFdlICpmYWNldCogb24gdGhlIGBnZW5lX3N5bWJvbGAgY29sdW1uIHVzaW5nIGBmYWNldF93cmFwKClgLiBXZSBhZGQgdGhlIHRpbGRlIHN5bWJvbCBgfmAgaW4gZnJvbnQgb2YgdGhlIGNvbHVtbiB3ZSB3YW50IHRvIGZhY2V0IG9uLiAKCmBgYHtyfQpnZ3Bsb3QoZGF0YT1teWdlbmVzX2NvdW50cywgbWFwcGluZz1hZXMoeD1Hcm91cCwgeT1sb2cyKENvdW50KSwgZmlsbD1Hcm91cCkpICsKICBnZW9tX2JveHBsb3QoKSArCiAgZmFjZXRfd3JhcCh+Z2VuZV9zeW1ib2wpCmBgYAoKSGVyZSB3ZSBvbmx5IGhhdmUgdHdvIHZhbHVlcyBwZXIgZ3JvdXAgc28gd2UgY291bGQganVzdCBwbG90IHRoZSBpbmRpdmlkdWFsIHBvaW50cy4gV2UgY291bGQgdXNlIApgZ2VvbV9wb2ludGAgdG8gbWFrZSBhIHNjYXR0ZXJwbG90LgpgYGB7cn0KZ2dwbG90KGRhdGE9bXlnZW5lc19jb3VudHMsIG1hcHBpbmc9YWVzKHg9R3JvdXAsIHk9Q291bnQpKSArCiAgZ2VvbV9wb2ludCgpICsKICBmYWNldF93cmFwKH5nZW5lX3N5bWJvbCkKYGBgCgpUaGUgcG9pbnRzIGFyZSBvdmVybGFwcGluZyBzbyB3ZSB3aWxsIHVzZSBgZ2VvbV9qaXR0ZXJgIHdoaWNoIGFkZHMgYSBzbWFsbCBhbW91bnQgb2YgcmFuZG9tIHZhcmlhdGlvbi4KCmBgYHtyfQpnZ3Bsb3QoZGF0YT1teWdlbmVzX2NvdW50cywgbWFwcGluZz1hZXMoeD1Hcm91cCwgeT1Db3VudCkpICsKICBnZW9tX2ppdHRlcigpICsKICBmYWNldF93cmFwKH5nZW5lX3N5bWJvbCkKYGBgCgpXZSBjYW4gY29sb3VyIHRoZSBncm91cHMgc2ltaWxhciB0byBiZWZvcmUgdXNpbmcgYGNvbG91cj1gLgoKYGBge3J9CmdncGxvdChkYXRhPW15Z2VuZXNfY291bnRzLCBtYXBwaW5nPWFlcyh4PUdyb3VwLCB5PUNvdW50LCBjb2xvdXI9R3JvdXApKSArCiAgZ2VvbV9qaXR0ZXIoKSArCiAgZmFjZXRfd3JhcCh+Z2VuZV9zeW1ib2wpIApgYGAKCiMgTW9kaWZ5aW5nIHRoZSBwbG90CgojIyMgU3BlY2lmeWluZyBjb2xvdXJzCgpXZSBtaWdodCB3YW50IHRvIGNoYW5nZSB0aGUgY29sb3Vycy4gVG8gc2VlIHdoYXQgY29sb3VyIG5hbWVzIGFyZSBhdmFpbGFibGUgeW91IGNhbiB0eXBlIGBjb2xvdXJzKClgLiBUaGVyZSBpcyBhbHNvIGFuIFtSIGNvbG91cnMgY2hlYXRzaGVldF0oaHR0cHM6Ly93d3cubmNlYXMudWNzYi5lZHUvfmZyYXppZXIvUlNwYXRpYWxHdWlkZXMvY29sb3JQYWxldHRlQ2hlYXRzaGVldC5wZGYpIHRoYXQgc2hvd3Mgd2hhdCB0aGUgY29sb3VycyBsb29rIGxpa2UuCmBgYHtyfQpteWNvbG91cnMgPC0gYygidHVycXVvaXNlIiwgInBsdW0iLCAidG9tYXRvIiwgInZpb2xldCIsICJzdGVlbGJsdWUiLCAiY2hvY29sYXRlIikKYGBgCgpUaGVuIHdlIHRoZW4gYWRkIHRoZXNlIGNvbG91cnMgdG8gdGhlIHBsb3QgdXNpbmcgYSBgK2AgYW5kIGBzY2FsZV9jb2xvdXJfbWFudWFsKHZhbHVlcz1teWNvbG91cnMpYC4KCmBgYHtyfQpnZ3Bsb3QoZGF0YT1teWdlbmVzX2NvdW50cywgbWFwcGluZz1hZXMoeD1Hcm91cCwgeT1Db3VudCwgY29sb3VyPUdyb3VwKSkgKwogIGdlb21faml0dGVyKCkgKwogIGZhY2V0X3dyYXAofmdlbmVfc3ltYm9sKSArCiAgc2NhbGVfY29sb3VyX21hbnVhbCh2YWx1ZXM9bXljb2xvdXJzKQpgYGAKClRoZXJlIGFyZSBidWlsdC1pbiBjb2xvdXIgcGFsZXR0ZXMgdGhhdCBjYW4gYmUgaGFuZHkgdG8gdXNlLCB3aGVyZSB0aGUgc2V0cyBvZiBjb2xvdXJzIGFyZSBwcmVkZWZpbmVkLiBgc2NhbGVfY29sb3VyX2JyZXdlcigpYCBpcyBhIHBvcHVsYXIgb25lICh0aGVyZSBpcyBhbHNvIGBzY2FsZV9maWxsX2JyZXdlcigpYCkuIFlvdSBjYW4gdGFrZSBhIGxvb2sgYXQgdGhlIGhlbHAgZm9yIGBzY2FsZV9jb2xvdXJfYnJld2VyKClgIHRvIHNlZSB3aGF0IHBhbGV0dGVzIGFyZSBhdmFpbGFibGUuIFRoZSBbUiBjb2xvdXJzIGNoZWF0c2hlZXRdKGh0dHBzOi8vd3d3Lm5jZWFzLnVjc2IuZWR1L35mcmF6aWVyL1JTcGF0aWFsR3VpZGVzL2NvbG9yUGFsZXR0ZUNoZWF0c2hlZXQucGRmKSBhbHNvIHNob3dzIHdoYXQgdGhlIGNvbG91cnMgb2YgdGhlIHBhbGV0dGVzIGxvb2sgbGlrZS4gVGhlcmUncyBvbmUgY2FsbGVkICJEYXJrMiIsIGxldCdzIGhhdmUgYSBsb29rIGF0IHRoYXQuIAoKYGBge3J9CmdncGxvdChkYXRhPW15Z2VuZXNfY291bnRzLCBtYXBwaW5nPWFlcyh4PUdyb3VwLCB5PUNvdW50LCBjb2xvdXI9R3JvdXApKSArCiAgZ2VvbV9qaXR0ZXIoKSArCiAgZmFjZXRfd3JhcCh+Z2VuZV9zeW1ib2wpICsKICBzY2FsZV9jb2xvdXJfYnJld2VyKHBhbGV0dGUgPSAiRGFyazIiKQpgYGAKCgojIyMjIEV4ZXJjaXNlCk1ha2UgYSBjb2xvdXJibGluZCBmcmllbmRseSBwbG90LiBIaW50IHRoZXJlIGFyZSBjb2xvdXJibGluZCBmcmllbmRseSBwYWxldHRlcyBbaGVyZV0oaHR0cDovL3d3dy5jb29rYm9vay1yLmNvbS9HcmFwaHMvQ29sb3JzXyhnZ3Bsb3QyKS8jYS1jb2xvcmJsaW5kLWZyaWVuZGx5LXBhbGV0dGUpCgojIyMgQXhpcyBsYWJlbHMgYW5kIFRpdGxlCgpXZSBjYW4gY2hhbmdlIHRoZSBheGlzIGxhYmVscyBhbmQgYWRkIGEgdGl0bGUgd2l0aCBgbGFicygpYC4gVG8gY2hhbmdlIHRoZSB4IGF4aXMgbGFiZWwgd2UgdXNlIGBsYWJzKHg9Ik5ldyBuYW1lIilgLiBUbyBjaGFuZ2UgdGhlIHkgYXhpcyBsYWJlbCB3ZSB1c2UgYGxhYnMoeT0iTmV3IG5hbWUiKWAgb3Igd2UgY2FuIGNoYW5nZSB0aGVtIGFsbCBhdCB0aGUgc2FtZSB0aW1lLgoKYGBge3J9CmdncGxvdChkYXRhPW15Z2VuZXNfY291bnRzLCBtYXBwaW5nPWFlcyh4PUdyb3VwLCB5PUNvdW50LCBjb2xvdXI9R3JvdXApKSArCiAgZ2VvbV9qaXR0ZXIoKSArCiAgZmFjZXRfd3JhcCh+Z2VuZV9zeW1ib2wpICsgCiAgbGFicyh4PSJDZWxsIHR5cGUgYW5kIHN0YWdlIiwgeT0iQ291bnQiLCB0aXRsZT0iTWFtbWFyeSBnbGFuZCBSTkEtc2VxIGRhdGEiKQpgYGAKCiMjIyBUaGVtZXMKCldlIGNhbiBhZGp1c3QgdGhlIHRleHQgb24gdGhlIHggYXhpcyAodGhlIGdyb3VwIGxhYmVscyBieSB0dXJuaW5nIHRoZW0gOTAgZGVncmVlcyBzbyB3ZSBjYW4gcmVhZCB0aGUgbGFiZWxzIGJldHRlci4KYGBge3J9CmdncGxvdChkYXRhPW15Z2VuZXNfY291bnRzLCBtYXBwaW5nPWFlcyh4PUdyb3VwLCB5PUNvdW50LCBjb2xvdXI9R3JvdXApKSArCiAgZ2VvbV9qaXR0ZXIoKSArCiAgZmFjZXRfd3JhcCh+Z2VuZV9zeW1ib2wpICsgCiAgbGFicyh4PSJDZWxsIHR5cGUgYW5kIHN0YWdlIiwgeT0iQ291bnQiLCB0aXRsZT0iTWFtbWFyeSBnbGFuZCBSTkEtc2VxIGRhdGEiKSArCiAgdGhlbWUoYXhpcy50ZXh0LnggPSBlbGVtZW50X3RleHQoYW5nbGUgPSA5MCkpCmBgYAoKV2UgY2FuIHJlbW92ZSB0aGUgZ3JleSBiYWNrZ3JvdW5kIGFuZCBncmlkIGxpbmVzLiBUbyBkbyB0aGlzIHdlIG1vZGlmeSB0aGUgZ2dwbG90IHRoZW1lLiBUaGVtZXMgYXJlIHRoZSBub24tZGF0YSBwYXJ0cyBvZiB0aGUgcGxvdC4gCgpUaGVyZSBhcmUgYWxzbyBhIGxvdCBvZiBidWlsdC1pbiB0aGVtZXMuIExldCdzIGhhdmUgYSBsb29rIGF0IGEgY291cGxlIG9mIHRoZSBtb3JlIHdpZGVseSB1c2VkIHRoZW1lcy4gV2Ugd29uJ3Qgc2F2ZSB0aGVzZSAod2Ugd29uJ3QgdXNlIGBwIDwtYCkgd2UnbGwganVzdCBwcmludCB0aGVtIHRvIGhhdmUgYSBsb29rLiBUaGUgZGVmYXVsdCBnZ3Bsb3QgdGhlbWUgaXMgYHRoZW1lX2dyZXkoKS5gCgpgYGB7cn0KZ2dwbG90KGRhdGE9bXlnZW5lc19jb3VudHMsIG1hcHBpbmc9YWVzKHg9R3JvdXAsIHk9Q291bnQsIGNvbG91cj1Hcm91cCkpICsKICBnZW9tX2ppdHRlcigpICsKICBmYWNldF93cmFwKH5nZW5lX3N5bWJvbCkgKyAKICBsYWJzKHg9IkNlbGwgdHlwZSBhbmQgc3RhZ2UiLCB5PSJDb3VudCIsIHRpdGxlPSJNYW1tYXJ5IGdsYW5kIFJOQS1zZXEgZGF0YSIpICsKICB0aGVtZShheGlzLnRleHQueCA9IGVsZW1lbnRfdGV4dChhbmdsZSA9IDkwKSkgKyAKICB0aGVtZV9idygpCmBgYAoKYGBge3J9CmdncGxvdChkYXRhPW15Z2VuZXNfY291bnRzLCBtYXBwaW5nPWFlcyh4PUdyb3VwLCB5PUNvdW50LCBjb2xvdXI9R3JvdXApKSArCiAgZ2VvbV9qaXR0ZXIoKSArCiAgZmFjZXRfd3JhcCh+Z2VuZV9zeW1ib2wpICsgCiAgbGFicyh4PSJDZWxsIHR5cGUgYW5kIHN0YWdlIiwgeT0iQ291bnQiLCB0aXRsZT0iTWFtbWFyeSBnbGFuZCBSTkEtc2VxIGRhdGEiKSArCiAgdGhlbWUoYXhpcy50ZXh0LnggPSBlbGVtZW50X3RleHQoYW5nbGUgPSA5MCkpICsgCiAgdGhlbWVfbWluaW1hbCgpCmBgYAoKVGhlcmUgYXJlIG1hbnkgdGhlbWVzIGF2YWlsYWJsZSwgeW91IGNhbiBzZWUgc29tZSBpbiB0aGUgW1IgZ3JhcGggZ2FsbGVyeV0oaHR0cHM6Ly93d3cuci1ncmFwaC1nYWxsZXJ5LmNvbS8xOTItZ2dwbG90LXRoZW1lcy8pLgoKV2UgY2FuIGFsc28gbW9kaWZ5IHBhcnRzIG9mIHRoZSB0aGVtZSBpbmRpdmlkdWFsbHkuIFdlIGNhbiByZW1vdmUgdGhlIGdyZXkgYmFja2dyb3VuZCBhbmQgZ3JpZCBsaW5lcyB3aXRoIHRoZSBjb2RlIGJlbG93LgoKYGBge3J9CmdncGxvdChkYXRhPW15Z2VuZXNfY291bnRzLCBtYXBwaW5nPWFlcyh4PUdyb3VwLCB5PUNvdW50LCBjb2xvdXI9R3JvdXApKSArCiAgZ2VvbV9qaXR0ZXIoKSArCiAgZmFjZXRfd3JhcCh+Z2VuZV9zeW1ib2wpICsgCiAgbGFicyh4PSJDZWxsIHR5cGUgYW5kIHN0YWdlIiwgeT0iQ291bnQiLCB0aXRsZT0iTWFtbWFyeSBnbGFuZCBSTkEtc2VxIGRhdGEiKSArCiAgdGhlbWUoYXhpcy50ZXh0LnggPSBlbGVtZW50X3RleHQoYW5nbGUgPSA5MCkpICsgCiAgdGhlbWUocGFuZWwuYmFja2dyb3VuZCA9IGVsZW1lbnRfYmxhbmsoKSwgCiAgICAgICAgcGFuZWwuZ3JpZC5tYWpvciA9IGVsZW1lbnRfYmxhbmsoKSwgCiAgICAgICAgcGFuZWwuZ3JpZC5taW5vciA9IGVsZW1lbnRfYmxhbmsoKSkKYGBgCgojIFNhdmluZyBwbG90cwpXZSBjYW4gc2F2ZSBwbG90cyBpbnRlcmFjdGl2ZWx5IGJ5IGNsaWNraW5nIEV4cG9ydCBpbiB0aGUgUGxvdHMgd2luZG93LiBPciB3ZSBjYW4gb3V0cHV0IHBsb3RzIHRvIHBkZiB1c2luZyBgcGRmKClgIGZvbGxvd2VkIGJ5IGBkZXYub2ZmKClgLiBXZSBwdXQgb3VyIHBsb3QgY29kZSBhZnRlciB0aGUgY2FsbCB0byBgcGRmKClgIGFuZCBiZWZvcmUgY2xvc2luZyB0aGUgcGxvdCBkZXZpY2Ugd2l0aCBgZGV2Lm9mZigpYC4KCkxldCdzIHNhdmUgb3VyIGxhc3QgcGxvdC4KCmBgYHtyLCBldmFsPUZBTFNFfQpwZGYoIm15cGxvdC5wZGYiKQpnZ3Bsb3QoZGF0YT1teWdlbmVzX2NvdW50cywgbWFwcGluZz1hZXMoeD1Hcm91cCwgeT1Db3VudCwgY29sb3VyPUdyb3VwKSkgKwogIGdlb21faml0dGVyKCkgKwogIGZhY2V0X3dyYXAofmdlbmVfc3ltYm9sKSArIAogIGxhYnMoeD0iQ2VsbCB0eXBlIGFuZCBzdGFnZSIsIHk9IkNvdW50IiwgdGl0bGU9Ik1hbW1hcnkgZ2xhbmQgUk5BLXNlcSBkYXRhIikgKwogIHRoZW1lKGF4aXMudGV4dC54ID0gZWxlbWVudF90ZXh0KGFuZ2xlID0gOTApKSArIAogIHRoZW1lKHBhbmVsLmJhY2tncm91bmQgPSBlbGVtZW50X2JsYW5rKCksIAogICAgICAgIHBhbmVsLmdyaWQubWFqb3IgPSBlbGVtZW50X2JsYW5rKCksIAogICAgICAgIHBhbmVsLmdyaWQubWlub3IgPSBlbGVtZW50X2JsYW5rKCkpCmRldi5vZmYoKQpgYGAKCgojIEV4ZXJjaXNlcwoxLiBEb3dubG9hZCB0aGUgcmF3IGNvdW50cyBmb3IgdGhpcyBkYXRhc2V0CiAgYS4gTWFrZSBhIGJveHBsb3QuIERvIHRoZSBzYW1wbGVzIGxvb2sgYW55IGRpZmZlcmVudCB0byB0aGUgbm9ybWFsaXNlZCBjb3VudHM/CiAgYi4gTWFrZSBzdWJwbG90cyBmb3IgdGhlIHNhbWUgc2V0IG9mIDggZ2VuZXMuIERvIHRoZXkgbG9vayBhbnkgZGlmZmVyZW50IHRvIHRoZSBub3JtYWxpc2VkIGNvdW50cz8KMi4gRG93bmxvYWQgdGhlIG5vcm1hbGlzZWQgY291bnRzIGZvciB0aGUgR1NFNjMzMTAgZGF0YXNldCBmcm9tIEdSRUlOLiBNYWtlIGJveHBsb3RzIGNvbG91cmluZyB0aGUgc2FtcGxlcyB1c2luZyBkaWZmZXJlbnQgY29sdW1ucyBpbiB0aGUgbWV0YWRhdGEgZmlsZS4KCgojIEtleSBQb2ludHMKLSBSU3R1ZGlvIGlzIGFuIGludGVyZmFjZSB0aGF0IG1ha2VzIGl0IGVhc2llciB0byB1c2UgUi4KLSBgaW5zdGFsbC5wYWNrYWdlcygpYCBpcyB1c2VkIHRvIGluc3RhbGwgYSBwYWNrYWdlcyBvbnRvIHlvdXIgY29tcHV0ZXIsIGBsaWJyYXJ5KClgIGlzIHVzZWQgd2hlbiB5b3Ugd2FudCB0byB1c2UgYSBwYWNrYWdlIGluIGFuIFIgc2NyaXB0IG9yIHNlc3Npb24KLSBgcmVhZF9jc3YoKWAgb3IgYHJlYWRfdHN2KClgIGNhbiBiZSB1c2VkIHRvIHJlYWQgaW4gY3N2IGFuZCB0c3YgZmlsZXMgcmVzcGVjdGl2ZWx5Ci0gVXNlZnVsIGNvbW1hbmRzIGZvciBjaGVja2luZyBkYXRhIGFyZSBgZGltKClgLCBgaGVhZCgpYCwgYHRhaWwoKWAsIGBzdHIoKWAsIGBzdW1tYXJ5KClgLCBgVmlldygpYAotIGBnYXRoZXIoKWAgY2FuIGJlIHVzZWQgdG8gY29udmVydCBkYXRhIGludG8gbG9uZyBmb3JtYXQgZm9yIGdncGxvdAotIGBmdWxsX2pvaW4oKWAgY2FuIGJlIHVzZWQgdG8gam9pbiBkaWZmZXJlbnQgZmlsZXMgCi0gKipgZ2dwbG90MmAqKiBpcyBhIHBsb3R0aW5nIHBhY2thZ2UgdGhhdCBtYWtlcyBpdCBzaW1wbGUgdG8gY3JlYXRlIGNvbXBsZXggcGxvdHMgYW5kIGhhdmUgMyBjb21wb25lbnRzOiBkYXRhIChkYXRhc2V0KSwgbWFwcGluZyAoY29sdW1ucyB0byBwbG90KSBhbmQgZ2VvbSAodHlwZSBvZiBwbG90KS4KLSBUaGUgYCtgIHNpZ24gaXMgdXNlZCB0byBhZGQgbGF5ZXJzLiBJdCBtdXN0IGJlIHBsYWNlZCBhdCB0aGUgZW5kIG9mIHRoZSBwcmVjZWRpbmcgbGluZS4gSWYgaXQgaXMgYWRkZWQgYXQgdGhlIGJlZ2lubmluZyBvZiB0aGUgbGluZSwgKipgZ2dwbG90MmAqKiB3aWxsIHJldHVybiBhbiBlcnJvciBtZXNzYWdlLgotIGBmYWNldF93cmFwKClgIGNhbiBiZSB1c2VkIHRvIG1ha2Ugc3VicGxvdHMKLSBnZ3Bsb3QyIHBsb3RzIGNhbiBiZSBlYXNpbHkgY29sb3VyZWQgYnkgY29sdW1ucyBpbiB0aGUgZGF0YXNldC4gYGZpbGw9YCBjYW4gYmUgdXNlZCB0byBjb2xvdXIgYXJlYXMgYW5kIGBjb2xvdXI9YCB0byBjb2xvdXIgcG9pbnRzIGFuZCBsaW5lcwoKCiMgRnVydGhlciBSZWFkaW5nCltJbnRybyB0byBSIGFuZCB0aWR5dmVyc2VdKGh0dHBzOi8vcG1hY2Rhc2NpLmdpdGh1Yi5pby9yLWludHJvLXRpZHl2ZXJzZS8pICAKW1RvcCA1MCBHZ3Bsb3QgVmlzdWFsaXNhdGlvbnNdKCBodHRwOi8vci1zdGF0aXN0aWNzLmNvL1RvcDUwLUdncGxvdDItVmlzdWFsaXphdGlvbnMtTWFzdGVyTGlzdC1SLUNvZGUuaHRtbCkgIApbUiBmb3IgRGF0YSBTY2llbmNlXShodHRwczovL3I0ZHMuaGFkLmNvLm56LykK